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PREFACE 


This volume is a revision and extension of a book by the same 
title publi8h(;d privately in lithoprinted form in 1935. The wide 
demand for the preliminary edition showed that there was a need 
for the type of pre8<'ntat.ion of statistics hero offered. 

The characterlstie feature of the book is the effort to explain 
the mathematical origins of the most widely used statistical 
formulas in terms that persons with comparatively little mathe- 
matical training can cjisily follow. We belkivc that, if statistical 
workers do not take their tools as magic but understand them in 
the light of their origins and assumptioiiis, they will use these 
tools mtjre intidligently and more safely. In order to make such 
understanding available to peraons of little mathematical train- 
ing mi give the derivations in much detail. It is a well-known 
fact that the source of difficulty in mathematical reading by 
relatively untrained persons is largely the omission of steps which 
are 8uppoH«td to bo obvious. When these steps are supplied and 
when the um of sptwialized mathematical terminology is reduced 
to a minimtim, much that would otherwise be closed to the reader 
is readily understandable. In order to make calculus available 
as a tool for those who do not have a command of it, wo open 
this volume with a chapter on calculus. This is, of course, only 
“a little calculus,” but it is enough to prepare the reader who has 
not hitherto studied calculus to follow the derivations in which 
we must draw upon this branch of mathematics. Our experience 
with this presentation, as well as that reported by some others, 
shows that this chapter on calculus can bo mastered in about 
10 per cent of the time nonnally allotted to a one-semester course 
in advanced statistics. 

The title of the book is somewhat too pretentious. It might 
better be called Some Slatietictd Procedures and a Little Insight 
ifUo the Mathemedi&d Bases of a Few of Them. It is not, of course, 
a comprehensive treatment of the mathematical bases of statia- 
tios. It is mtended to brid^ the gap between the elementary 
courses, in which tire formulas are ^ven purely authoritatively, 
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and the original contributions in tho monograplu<’. press, whi<>h 
are often highly mathematical in chariu'tc'i*. We had hoped to 
be able to include in this volume a stiction on tho geomt>(.ry of 
hyperspaoe, matrix algebra, and oth<>r forms of advamu'd mathe,- 
ma1.ics basic to the reading of present, -day st,at.istieal literabiro. 
We had hoped to make this paralh'l in simplieit.y our ehaj)t.<>r on 
calcuhis. But wo found that,, if t.his were <,o bo nuido really 
intelligible without bt'iug superficial, w(> would lu'ed to alh)t to it. 
an amount of additional space that would not be feasible witli- 
out sacrificing the other and simph'r funcl.ions whiidi this volume 
is intended to perform. An introduction to t.he geoumlry of 
hypcrspaco, as well as to some other forms of higher matheinati«‘s, 
is really indispensable to anyone who wishes to folltnv contem- 
porary statistical theory. But it will probably nts'd to be set up 
in a separate volume — a chatty, leisurely volunui. 

In this edition wo have included many of the statistusd toeh- 
niques advocated by R. A. Fisher and have uraU‘rt!tk<'n to bring 
them into synthesis with classical Ht,atiHticH. We «io md believe 
that tho Fisher techniques will prove to have the importamsf 
for research in the psychologicjil and social selenees that they 
have in the biological scieiKXis, because in the former fields it is 
unnecessary to work much with small samples ami with rough 
exploratory research. Certainly tho Fisher t<'chnH{iu*s will 
only supplement and not supplant tho chissical laetiHtds tit 
tho psychological and sotiial sciences. Novertheh-ss, we helievi* 
that the workers for whom wo are writing in these fij'lds are 
cntitlod. to know what these tcchnuiut« are. Wo have atkunptcal 
to take the magic oiit of them, as wo did also out of elasshnU 
statistics, by explaining them in very simple terms and by show- 
ing how they fit in with tho older methods. In this way wo 
hope to bring it about that tho workers in tlu» fields for whielj wo 
are writing will find some uscJul ek'incints in them wit hout gr»isj>- 
ing at them as some “new magic” and unwarrantially thmwing 
away the vastly useful techniques of classical statistics as 
“antiquated.” 

We are glad to acknowledge our very great indobtednosH to 
the work of Prof. Truman L. Kelley. Indeed, when this Ijook 
was first begun it was intended merely as a footnote to his 8UUi»- 
tied Method, Even though frequent explicit references to this 
book are absent, the informed reader will see that our treatment 
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was shaped largely by Kelley’s and often closely parallels his. 
In the further dcvolopmcut of the work we went, of cour.se, 
directly to the sources in the monographic literature, and hence 
wo are obligated to Karl P<^arson and the many other scholar-s 
who contributt^d to that literature, a very large portion of whom 
wrote undtir the iiuspiration and the guidance of Pearson. Wo 
desire to <'.xpr('.ss our gratiUido to members of the mathematics 
depart.ment of the Peninsylvania State College, especially to 
Clyd(‘ 11, Gravo.s, for (iomiietent coumsol on technical mattens 
given unstintedly every time wo had occasion to seek such help. 

Wo arti also indebted to Prof. 11. A, Fisher and his publishers, 
Oliver and Boyd, for permission to use the table of the distribu- 
tion of / which we reproduce on page 173; to Prof. Egon S. Peat^ 
son, editor of liionu-trika and the Biometrika Publications, for 
pi'rmission to use the two tables on the normal curve integral, 
pages 4S1 to 487, and the <‘hi-.s<piaro table page.s 408 to 500; and 
to Mrs. Marjory Goaset of Oxford, England^ — wife and heir of 
William Scaly Gosset, the brilliant English scholar who signed 
his .statistical article's “Student” — for p(‘rmi.ssion to use his tables 
of t published in Mdron in 1U25, which tables we give on pagtss 
488 to 403 of this volume. 

C. C. E 
W. R. V. 

Statb Coixsax, Pa., 

AuffUHt, 1940 . 
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CHAPTER I 


A LITTLE CALCULUS 


This chapter is intended for persons who have not previously 
studied calculus. It presents, in a way that a reader w^ho has had 
only a limited training in mathematics should be able to follow, 
practically all the calculus upon which we shall iiave occixsion 
to draw in this volume on statistics, which inchKles many funda- 
mental elements common also to applicat ions in other fields. We 
trust that this simple presemiation of thti olenuuils of diffenuit.ial 
and integral calculus may not only prove useful to t.he studemt of 
statistics but that it may also give to laymen in mathematics an 
interesting and culturally enriching insiglit into the nature and 
applications of this fascinating mathematical discipline. 

In every case whertj one quantity varies in a manner that is 
definitely relat<d to the variation in 
a second, the relation between the 
two may be represented geometric- 
ally by a curve of some shape (in- 
cluding a straight line). Take first ^ 
the simple relation y « x, where x 
may be represented by any number 
and y will therefore of imcessity be 
the same numl>er. We may lay off 



this relation on the adjacent diagram. 
When X « 1, y » I 5 when x » 2> 


Fxa. 1.— 'Straight line relation} 
Slope 1. 


y •" 2 , etc. If we go to the right one unit for x and then up one 
unit for y, we shall have a point Xiyi, that shows the relation 


between the two series at that value of x. If we go two units to 


tibe right and two units up, we shall have a second point x^t; etc. 

X 
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A straight liia' may bo draw n through all thorn* points, Its slopo 
will 1)0 1, a, Hi ■ ■ ■ ~ «lopo will always bo thosamo 

at all valuos of .r, 

Supposo. now, that // - 0.4/. Wo shall tht>n havo a lino 
roprcsnnting tho relation as follows: 


Y 



Hero likewise, wo can /(‘present the relation by a straight lino, 
and this line will luive the same sloja* at every vaha* of /; at (*aeh 
point a ohangi' of n nnits in * will be aoooinpanied by a eiiangt' 
of 0.4 « units in ;/. 

But let us now take a more eomplieated o.'ise, y - 


Y 



4, 16 |ii,t,_ 3. — Curved line rriation! 

(•linnitM with X. 


Hero tho lino is not a straight one; it does not have tho name 
slope at all values of x. As wo proceed out from the u axis, tho 
slope is at first very small; at z 1 it is moderate; and at z 3 
the slope is very steep. We have a similar behavior on the idde 
whore z has negative values. We have, in fact, very great 
difficulty in sajdng what the slope is, because it is always chang- 
ing. We could draw a straight line between A and d, where 
z O’ 1 and z «■ 2, respectively, but the slope of this Use would 
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not precisely describe the slope of the curve. If we took a smaller 
change in z, say that represented by the distance AB' on our scale, 
our secant lino would nioi-c nearly coincide with the curve. Wo 
may consider A as any fixed point on the graph and allow B to 
move along the curve and approach A as a limiting position 
The changes in z would bc'come smaller and smaller and approach 
zero as a limit. Tlws secant line drawn through A and B would 
turn about A, approaching the tangent line at A as its limiting 
position. 

Now the basic task of the differential calculus (except in 
regions of discontinuity and other similar matters which lie 
beyond the scope of t his chapter) is to ascertain the slope of a 
curve at various points by determining the slope of a secant 
which, in a limiting i)osition, becoraas the tangent to the curve 
at the point in question. This same idea may be expressed in 
other terras by saying that it is the task of the differential 
calculus to ascertain the amount of change in a variable y that 
corresponds to a certain change in a related variable z as these 
increments in the independent variable x become so small as to 
approach zero in value. At certain times in its history this 
discipline has been called the infinitemnal calculus in recognition 
of the fact that it deals with the rtilation of infinitesimal incre- 
ments of one variable to infinitesimal increments of another. 
In operating with the calculus wo are often operating algebraically 
with no curve in sight; but usually we can ropnwont these 
algebraic oiK*ration.s geometrically and show that what we are 
seeking is something about the slope of that curve at some 
point. 


DIPFERBIfTIATION 

I.ict us proceed with that algebraic process with which we said, 
in our preceding paragraph, wo shall often bo operating with 
no curve before us visually. Wo have the equation 

Jf m X* 

We wbh to find what change in y goes with a change in z at 
any vjdue of z in which we are interested. Lot Ax be an incre- 
ment to be added to z (algebraically), and Ay be the correspond- 
ixig increment that would need to be add^ to y in order to 
maintiuQ the equation. 
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(1) 2 / + A?/ = (a: + Ax)® 

PcrforniinK the inclifatod square, 

y + Ay = X® + 2;r Ax + 

But our oriRinal oqtialion save us y -- x®. Wo may suhlraet 
the terms of this <‘qualioii from iht' <‘(»T<'spi)ti(lins oui's of our 
last equation above on the Iwisis of the axiom, "If <«qu!tls Ik' 
Rubtraoted from equals the remainders are (‘<iual.’' slnill 
then have 

(2) Aj/ = 2x Ax + Ax* 

Dividins through by Ax, we shall have 

(3) -^.2x + i* 

We said Ax should be an increment added to r atul Ay an 
increment add<'d lo y, but we. did not commit ourselves ns 1i» 
the particular size of the increment. L«'t. us ntm* conceive of 
Ax as decreasing until it Insmmcs infmih'simal in size. It will 
necessarily drag Ay down with it., sinci.' (he etjua(ior» must e«>n- 
tinue to hold for all values of Ax. Wlicn Ax hits become so small 
as to have approached zero its its limit let us replace Ay/ Ax by 
dy/dx. At this limit the Ax in the last term of our equation will 
approach zero in value and thus disapiu'ar from consideration. 
The reason why dy/dx can not Ixi similarly dwpped ns of zero 
value is that both its numerabir and its denominator Ix'conio 
small together so that the fraetion has a value that may be of 
considorabUi dimension. And so as the limit zero is approached 
by Ax we have 

(4) - 2* 

TWs 2x is called the derivative of the expression y «■ »*. Tho 
process of getting it is called differentiation. If the dx appears 
in tho denominator of tho fraction expressing tho derivative, we 
say that we are differentiating “with rospoot to x“j if tho dy 
appears in the denominator, as it will sometimes do In ouf later 
developments, we say we are differentiating “with respect to y.” 
This process sdone, in more or less oompUoated forme, oonatilutee 
essentially all there is to the differential calculus. In terms of 
the slope of a curve a derivative equal to 2a; means that, at the 
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point whero .r = 1, tho slope of the curve is 2 times 1 or 2 (which 
m(^ans that, at that point the y values arc changing twice as 
rapidly as the x values through the infinitesimal distance to which 
we have shrunken our A* at its limit). At the point where ® = 3, 
the slope of the curve relating the two is 2 times 3 or 6, which 
means that y changes 6 units for each unit of change in a:. 

After a f<ov more concrete examples we shall seek a general 
rule for differentiating an expression directly without going 
each time through a long proce.sa of algebraic manipulation. 
But, in the meantime the reader may be interested in observing 
the n'lat ion of the form of the 2x to the x- of which it is the deriva- 
tive. He will notice that the exponent of the x has dropped from 
2 to 1, a decrease of one unit. He will also observe that the 
eoeffieient t>f th<? derivative has Income 2, possibly the same 2 
that was lost from the original exponent; about that we shall 
see later. 

Ijot us now try different, iating the expres.sion y — x\ Wo 
shall go through the same four fundamental steps, through, 
which wc [Missed in our previous example, as follows: (1) Add 
Ay to t he y and Ax to the x and perform the indicated involution. 

(2) Subtract from the resultant equation our original equation. 

(3) Divide through by Ax. (4) Ijot Ax approach zero as a limit, 
and, as the limit is approachtid, substitute dy/dx, the symbol 
for the derivative at the limit, for Ay/ Ax; drop from the equation 
any of these Ax values that stand without a A denominator, on 
the ground that even in the first power their values are approxi- 
mately zero and that in any of the lugher powera the values 
are lower than in the first power. 

y 

Adding Ay to y and Ax to x, 

(1) y + Ay » (x 4- Ar)* 

Expanding the second term, 

y 4“ Ay “ X* + 3x*Ax + 3x Ax* 4- As? 

Subtracting, 

(3) Ay 3x*Ax 4- 3x23* 4- 23* 

Dividing by Ax, 

(3) ^-8x*4-3xAx4'5s* 



6 


STA'l'lSTlCAI, PUOUlCDUttKS 


Letting Ax api>roa(‘h zero, 


(4) 



In this last expression (he lix Aar dropped ont in (he limit. 
be(“auae as Ax approiwtlw's z«'ro as a limit,, any product, formed 
by nmltiplying it by any factor approaches zero and, in (he 
limit, disappears from tin* eq\in(ion. For a similar reason the 
Ax* becomes zero in the limit. In fact sinc,e A* beconms, as it 
decreases, a very small (piantity (f.c., a decimal {piantity l<‘ss 
than 1), when nus<Hl to any pow<‘r (including 1) and imiltiplicd 
by 1 or by an^' other factor it will approach zero ntul vanish 
from the equation as Ax approaches zero sis its limit. 

Th(‘ di'rivative of y — x* is, tlu>refore, .'ix*. Notice that !>ere, 
again, the tiriginal expommt has become tlM‘ cocificicnt of the 
derivative and that thl^ (‘Xiioiwmt of the x in the derivative is 
one less than that of (h<j original (piantity. Let us now taki* a 
more generalized example, 


y Bs X* 


where n may represent any positive integer,* Performing in 
succession our four fundamental steiw, 


(1) y + Ay = (x + Ax)" 

Expanding, 


j/ 4- Ay »■ »" + n«"“*Aa5 + 


w(h — 1) 
.. ; 2 






was our original equation, to Ijo Bubtra< 3 tod, 

(2) Ay — n®*“*Aa! 4 * s""®* 

+ . . . 

‘ It may be rihown that tiie rule for difiwe&tiadiig functions of tbk form 
will hold for any real value of ». 
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:3) 


Ax 


nz 


■n— i 


+ 


n(n — 1) 
1-2 


a:»-*Ax 


7t(w - l)(n - 2) 2 


1 •2-3 




Letting Az approach zero as limit and observing what was 
jaid above about the vanishing of all powers of that stand 
without a A denominator, we have remaining 

^ =» (Derivative of the function j/ * z^) (1) 

aX * 


From this general case it is now obvious that what we inferred 
18 a possibility in our two previous examples is in fact the rule: 
!Ae derivaiive in respect to x at any power has as its coefficient the 
original power of x and as its exponent the original exponent 
iecreaaed by 1. This must be so because only the second term in 
the binomial expansion is free from the Ax after the subtraction 
of step (2) and the division of step (3) and because the coefficient 
of the second term in a binomial expansion is always the power 
to winch the binomial is being raistsd and its exponent is always 
the ori^nal exponent less 1. 

Suppose now we try the effect of a constant as coefficient of 
our variable x, 


jc = ox" 


Here o may represent any coefficient wo please, whether integral 
or fraction, whether positive or negative. Going through our 
four steps, 


( 1 ) 

y -f Ap 


y + Aj/ 
ox** + aTix'‘“‘Ax + 


=s o(x 4- Ax)" 
1-2 


, an(« — l)(rt ~ 2) 
^ “X"2-3 


x"'"*Ax* + • • • 


(2) Ay ■■ atffc'*“‘Ax + — x"-“Ax* 

jj. , , . 

1 * 2 • 3 

(3) ^ onx"*"* + »»-*Ax 

+ + • • • 
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(4) 


^ = onx""* 
ax 


(Dprivatiyo of a rouHlant 
» futtolion of tho form j"j 


12) 


Hero the constant reapjwars in the dcrivniivo nuchanKcd. 
Hence, since a may repres«mt any constant, wc may say; The 
tlmvativc of a constant times a ftinHion u the same constant times 
the. dc.rimtive of the function. 

Ij<d. us now take a inon* (a)mplicalc<l expression, one inv<tlvlnK 
T in each of several terms with difTt'rent. powt'i's in each term, the 
total function being the sum of these several functions, 

y = ax* + 6x* + <*x 

(1) y + Ay - ax* + Sax-Ax + 3ax Ax® + n Ax^ ?>x» 

+ ‘2bx Ax 4" Ax* h fx +• f Ax 
y = ax* + bx* + cx 

(2) Ay = !kix*Ax + SazAx^ + a Ax* + 26x Ax + h Ax® 4- e Ax 

(H) ■= 3ax* 4" 3ax Ax 4- « Ax* + 26x 4* b Ax 4* c 

f4t ^ 4. r 4- /• (Derivative of the sum of /.j* 

5x * ^ ^ ^ funetituis) V») 


If tho reader will compare this derivativt* with the exfiressitm 
we started out to diffenmtiate, he will tibserve ( hat t he tlerival ive 
of the complex quantity made up of the sum of three tiTins is 
precisely the sum of tho derivativtfs of the sevenil ternis if dif- 
ferentiated separately. If ho will carry through on paimr the 
generalized ctwe or visualize to himself how it wouhl work out, 
he will easily convince himscslf that that same conehision would 
hold universally for any values for which the binomial law holds. 
Therefore, the dematm of the sum of any nmnbcr of functions ia 
the mm of thdr derivatives. 

Ijct US now try differentiating a constant, y « «. Hi nee 
■» 1, the above equation might bo written 

y mx^a 

Going through our four steps, 

(1) y + Ay "" (* Hh A»)®o ■■ a 

Subtraoldag our origbud equation, y o, we g^t 

(2) Ay - 0. Then (8) ^ - OJ and (4) ^ - 0 
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Thus the derivative of a constant is found to be zero. If tlie 
reader will think of the a as placed as an addend in the series 
above when wo were generalizing about the derivative of a sum 
of functions, he will perceive that it would behave in the same 
manner there as w'hcn standing alone; i.c., its derivative would be 
zero, and it would not appear in the sum wliich constitutes the 
derivative of the complex function. So in the process of dif- 
ferentiation, any (ionstant independent of the variable with 
respeot to which we arc differentiating disappears entirely from 
the derivative, since its own derivative is zero. 

We have now covered the s mplest ca.ses of differentiation. 
We have y<!t to consider the complicated situations in which the 
term wiih nsspect to w'hich we are differentiating occtirs as an 
exiK>nent, as a product, lus the denominator of a fraction, etc. 
B\it la^fore we proceed further let us draw together our findings 
so far, when wo diff<!rentiato a function with respect to x, and 
make some appli<-.afions of them. 

1. The derivative of a simple monomial containing any power 
of X is another monomial containing as its eoeffieient the original 
oxpmwmt of x times the original eo<dficient and as its exponent 
the original ((xponent <liminished by 1. 

2. The derivative of a constant times a function is equal 
to the constant times the derivative of the function. 

3. The derivative of a sura of monomials is the sum of the 
derivatives of thtwe monomials. 

4. Terms indep<‘ndent of x disappear from the derivative when 
w«! art! (lifferentiaCmg with respect to x, since the derivatives of 
any suc.h Utrms are zero. This is on the assumption, of course, 
that these terms do not contain the y or any other function of x. 

On the left below wo shall place certain equations to bo differ- 
entiaUtd with rtsspect to z; on the right we shall indicate the 
derivatives of some of them while leaving others blank for the 
rcadtfr to complete as an exercise. 


Function 

l>«^rivativc 


VZx^ 

If * + 10 


^ «i 


y M 8x 5 

2« -3 

y m ^ ^ + iMP+7 

■g - 8 +5 

^ » 7ai - 4^ 

^ si 2j!”t 
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2 / «» s{Zs^) 

y «« -- 3x* + 8 

-3“^ ♦> 

?/ - ^ 

j/ »« Ox”’ + 7x“* + X 


MINIMA AND MAXIMA 

In order to get. afr<\slv in mind the nu'aning of a derivative., let 
UH gniph the {>quatiou y ~ r" ~ dx — f». IIm derivativi', iw 
givt'ii alK)ve, i.s (2x — 3). I'liis indieat.t'.s the rate at whieh y 
is changing wlu'n x has any given value. When put graphieally, 
it mean.s that at any vahu^ of x the slopt^ of the line representing 
the relation of y to x is (2x -- 3). Isd. us list ht'iow some values 
of X and somv. eorr<'spomling valutas of y d<'rivj*d from the **rigimil 
equation. In Fig. 4 \vt! shall loe.aU? th<'.He calculated points and 
shall draw through them a .smooth curve. As saifl above, the 
fact. that. th<* <lerivative is (2x — 3) indicates that the slope of the 
curve at any value of x is (2x — 3) and that at any such value 
of X the y is changing (2x — 3) times as raphlly as the x. Exa- 
mine the curve at a few points in onl<»r to confirm this fact. 
When » s= — 2, the derivative is (2 • ~2) — 3, 



Fia. 4. — Qrnph c( t.h« aqiistion 
V — 3* — 6, 


a y 
-8 +18 
-a +8 
-1 - 1 
0 - » 
+l - 7 

+a - 7 
+8 - 6 
+4 - 1 

+8 + 8 
+8 +18 


which equals —7. This statement indicates that the y value 
is 4<:creasing seven times as fast as the z is inoreadng — that, if 
one followed the graph with a pencil, the pencil would be moving 
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downward seven times as rapidly as it is moving across the page 
toward the right. Does inspection of the curve indicate to 
you that such is true? Let x - I'J. Then the derivative is 
(2 • I'lf — 3), wliich equals zero. This means that hero y (the 
vertical di.stancc) does not change at all as you move along the x 
(horizontal) direction — provided, of course, the distance through 
which you move is an extremely short one. Does the figure 
bear that out? Let x be 3. Then the derivative is 

(2 • 3 - 3) = +3. 

The y should be increasing three times as rapidly as the x is 
increasing. Doe.s that look plausible? The reader may bo 
interested in making additional sijppositions about a: values and 
in seeing how the derivative indicates the slope of the curve at 
those poinUs and consequently the relative rapidity of changes in 
y iis compared with changes in x at the points in question. No 
matter what the connection, differentiation always has precisely 
the sort of meaning and significance involved in this illustration. 

Figure 4 lends itself so well to a comment about minima that 
wo cannot refrain from entering that topic here. That will 
carry us, oven at this early stage of our study, into the very 
heart of one of the most impof-tant applications of the differential 
calculus. We saw that when x ** li, the slope of our curve was 
zero. To this point the slope has been negative; i.e., to this 
point it has btsen descending for increasing values of x. From 
this point on the slope is po-sitive; i.e., the curve ascends for 
increasing values of x. Consequently the lowest value that y 
can take lies at this point where x equals 1^. In other words, 
y is then at a minimum. To find the point in x values where y 
is at a minimum is one of the most important applications of the 
calculus. Wo chanced to take m a value for x, and the slope 
turned o\it to be zero. But wo could easily have gotten this by 
calculation. We could have sot (2® — 3) equal to zero and 
solved the equation to find x under this special assumption that 
(2® - 3) is to equsd zero. We would have the following simple 
operation: 

2® — 3 ■« 0; 2® >■ 3; therefore » «■ 14 

Always, ^hen we wish to find a minimum, we differentiate our 
function mth respect to the variable on the scale of which 
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WO dosim to know tho position of tho minimum in (lw> rcliifod 
variai)lo, set the derivative (>qual to zero, and stdvt* fur tlie 
unknown t(*rm. Since tliis mal.ttT of minima is so imp<ir)aJi( in 
statistics for the sake of wiiich wo are at present, studying calculus, 
as well as in most other areas in which calculus is employisl, 
perhaps it will pay us to stay longer w’ith the topic and illustrate 
it more fully. So let tis take anot.h<*r example- one right out of 
statistics. 

In the following equation y represcmts the errors squart'd in 
fitting a straight line to pairetl uumhers. If we can fimi a value 
for r that will make this y a minimum, w<s shall liavt! om' formiilii 
for a coefficient of correlation. 

-hr® 

The variables here arc the y and the r; all other t4*rms are ron- 
Htants. We wish to find that value for r that will make y a 
minimum. We must, the.r(‘for<‘, difTeouitiate the »'xpr«*MHion 
with nwpect to r and set tlu^ d«'rivativ<> eipial to zi'ro. IhunemiMT 
that, if a constant is indep('nd<*nt of tlus variable with n'sjM'ct 
to which we are differentiating, it will disapixiar from the deriva- 
tive because its own d»)rivative is zero. But renwunts'r titat, if it 
occurs as a coeffuaent of our variable, it will nsappear as ii eernffi- 
cient in the derivative. Differentiating, then, according to our 
rules, 

dr N 

Now sot this dorivatrivo equal to zero and mjIvo for r. 

This is the formula for the coefficient of enrodation when our 
data aro in the form of “standard meiwures.” But wo shall learn 
more of this later; just now our atUmtion is focused on the method 
of finding that value of the one variablo at wiuch the oUter is a 
minimum. 

Try next 


y «■ 8» - »• 
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Differentiating, we get 


Setting the derivative equal to zero and solving for x, we have 
8 — 2j; = 0; —2z — —8; therefore x = i 

Our miiiimum should be where x = 4. Let us see how that looks 
on a graph. Wo shall determine from the original equation some 
values for y from given values for x and then construct the curve 
passing through those points. 



Wait a minute! The curve is flat at a; = 4, that is true, but y 
is not at its lowest point. It is at its highest point instead. So 
far from being a minimum at » = 4, j/ is then at a majumum. 
Now that wo think of it, we st^o that wo may have a slope of zero, 
and consequently a horizontal direction of our graph, at the top 
where the curve has stopped mounting and has begun to descend 
as surely as at the bottom where it has stopped falling and has 
begun to ascend. When, therefore, dy/dx = 0, y is either a 
minimum or a masimum. How can wo tell which? 

In the sort of curves with which we have be<m dealing, the 
slope of the line itself changes for different places along the 
X axis. At some points it becomes steeper and at others less 
steep; at some points it is rising and at some it is descending. 
Evi^ntly the change of slope is itself a function of *; tho 
rapidity of change in the slope is predetermined by the place 
along the x axis with which we are concerned. We might, 
therefore, differentiate the expression for the slope itself and get a 
value for the rapidity and direction with wldch the slope itself is 
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cJiunginp; for various valuos of x. If at tho point iu which \vt> 
arc interested (l)ee!uise, jH'rhaps, at that point the 1 / is either a 
maximum or a minimum), the second derivative has tlie negative 
sign, that, means tliat,, if we proc,ee<i<‘d toward the higiier vnhte,s 
of z, our slope vvouUI la-nd in the minus <iire<‘lion downward, 
We would, therefore, hfive Ix'en at th<‘ l<»p of our curve, atid nur if 
would have l>e<'n at a maximum. If, howeva'r, tht* sign of the 
second derivative is positive, that- miains that, as we move 
from that point up the z seal**, our <'urv(> must ttemi upward 
(which is lh<' plus direetion)> ti»<I 've learn thereh.v that what we 
had was ti minimum value of , 1 /. Let tis try this on the last 
example diff<’reutiated aiwve. Our dt'iivalive was, you reaietn- 
Ix'r, (8 — 2x), and at our critical point this was ejpia! to aero, 
so tliat we h.ad 

* . » - 2 ^ 0 
dx 

W<' may de-signatt* the .second tlerivaiivt' Ity (hu/dx’^. 't'aking 
this .second d(>rivative according to the sanw rule,s we two for 
a first dt'rivafive 

d%y „ f/(8 -■ 2x) „ 

(ix* “■ dx “ 

Sure enough, the second derivative is negative. It is this 
fact that it is negat.ive rather tlutJi that it is nuitieriealiy eqtml 
to 2 that itderests us at, present, for our (uily eoneeru n«iw is to 
know whether tlie curve would la-nd upward «>r downward if 
wc prota'edj'd out from tins point. Our fintiing from the second 
riiffenmtiation is ctutsistent with our graph; y is a maximum 
wiusn T = 4. 

Ix5t us now go l)ack and see wladher wm were eomset in sup- 
posing that our previous two examples InvolvtHi minima mthur 
than maxima. In our first examplu (tlte graphed one) 

y - *» - 3» - 6; - 2a: - 3; - 2 

Tius second derivative has the plus sign, and we wore, therefore, 
correct in caiUng the y a minimum at riie point where the slope 
was aero. 

In our second illuHti«.tion, involving the oorrdatiou formula, 
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Here, again, the second derivative is positive in sign, and, 
consequently, we have a minimum for y. 

Let us take yet one more exercise in this interesting topic of 
maxima and minima. A gardener wishes to enclose a tract of 
land with a high deer fence, and he wishes to know in what 
proportions he should lay out a rectangular plot so as to get 
the maximum amount of space enclosed with a given amount 
of fence. If we let k oqxial half of the given perimeter of his 
proposed tract, his diagram will look 
like Fig. 6. Let y be the area. Since 
the area of a rectangle is the product 
of its length by its width, 

y = *(fc — a:) = k* — a;® 

Differentiating this so as to ascertain for what length of x the 
area y will be a maximum and solving for x, 

g = k - 2a: = 0; -2ai = -k; a; = I k 

In order to make sure we have a maximum and not a minimum, 
we shall take a second derivative. 

d%y _ d(k - 2a;) _ „ 
d** di ■ “ ^ 

The second derivative is negative, and, therefore, what wo 
have is a maximum value for the area. So the field will be laid 
out most economically if the length is half the sum of the length 
and the width; t.e., if the length equals the width and hence the 
tract is laid out square. 

We shall later learn that there are circumstances under which 
we need to take a third derivative. It is, in fact, possible to 
differentiate as many times in succession as wo please and as our 
purpose requires. 

Mter this excursion into maxima and minima, from which we 
hope Uie reader will have deiived a more complete comprehension 
of the meaning and possible applications of the process of 
differen^tion, we shall take up a^n the technique of differ- 
entiating different algebntio forms. So far we have had only 
the dmplest ones. We have to learn how to differentiate a 
pioduet, a fraction, a power, a lc^;arithm, etc. 


X 

K-x 

Fio. 6. 
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THE DERIVATIVE OF A PRODUCT 
We have already learned how to handle the differentiation 
of a function of x that involves a polynomial. From now on we 
shall let a single letter (say u or v) repr<\sent th(^ function of x 
no matter how complex that function may be;; for we know tlmi., 
if we are called upon to differentiate m or t; in any connection, 
we shall be able to differentiate the complex function of x that 
these simple symbols represent, tlsing u and v, then, to stand 
for functions of x, we shall inquire how to differentiate a pixahict. 

(1) y = uv 

y + Ay — {u + Au)(v + Av) 

Expanding, 


y + Ay = uv + u Av -j- V Au + Au Av 
Subtracting our original equation, 

(2) Ay = u Av + vAu + Au Av 

Dividing by Au, 


(3) 

(4) 


^ _ dv 
dx~ ^ dx 


+ f 


Ay _ 
Ax ~ 
du 


u Av 
Ax 


+ 


dx 


V Au 
Ax 


+ Au 


Av 

Ax 


(Derivativti of a product) 


(4) 


The reader must have in mind in the transition from step (3) 
to step (4), and must continue to hold in mind in this transition 
in all the following developments, that wo make the transition 
by letting Ax approach zero as its limit whereby the A's in the 
numerator will be dragged down with the Ax; and, as the Ax 
approaches its limit, wo replace Ay /Ax by dy/dx, or whatever 
other symbols happen to represent our functions in the particular 
problem. He must keep in mind, too, that, when a A is approach- 
ing zero as a limit and is not divided by another A which is also 
approaching zero as a limit, it drops out of the equation at the 
limit because its value is zero and it carries out with it all other 
factors by which it is multiplied. 

Thus the derivative of a product turns out to be the first 
factor times the derivative of the second plus the second factor 
times the derivative of the first. The foUowing is a more con- 
crete example: 
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,, - I - ^ M 

— (4ax® • bx*) + (2bz ■ ax*) — 4abx^' + 2ahx’’ = 6(ibx^ 

That is exactly what wo would have obtained if, at the l>eginning, 
we had multiplied our two factors together and had differentiated 
the prodtict, m the reader may wish to verify. In this case that 
would have been ju.st as simple. But, of course, not all cases 
would permit such ready combination of the original factors. 


THE DERIVATIVE OF A QUOTIENT (FRACTION) 
Taking again u and v as functions of x, let y — u/v. 


( 1 ) 


y + Ay = 


ti + ^ 
V + Ao 


Subtracting from this the original equation. 


(2) 


Ay 


ti + ^ 
» + Ao 


u 

V 


Raising both fractions to a common denominator so that we may 
subtract, 


Ay 


4- a Am — w — M Av 

t>(o + At») v{v + Atf) ~ 4 p A» 

* » Am — M A» 

4 V A» 


(3) Dividing by A*, 

^ oCAw/Aa) -■ M(Ag/Aa;) 
Aa; p* 4 t> Ap 


Lett^g Ax approach zero as a limit, 

^ _ ,(.iu/dz} - uid,/^l ( 5 ) 

dx 


THB DBRIVATTVE OF A FUNCTION OF A FUNCTION 
It often happens that an expression is complicated in a fashion 
that makes it difficult to differentiate in the straightforward 
mhnner we have eo far learned. We may then End it feasible 
to simplify our procedure by diviffing the process into two or 
mote steps. Let us wdte the function, 
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Ay _ Ay _ Au 
Aa: ~ Au Ax 

where y is a function of u and u i« a funei.iou of a:. Now hd. 
Ax approach zero uk a limit. As Aa; upproachcH zero a,s itw 
limit, it will necessarily carry with it the A’s of its fuiu'f.ions. 
Hence 

dx du dx 


That is, we may break up our expn'asion into (avo fiu-tors, 
differentiate the first with respect to u and the u with respect 
to X, and take as our derivative the product of these two. Take, 
for example, the expression, y = VCx* — 2a)*, which ('quals 
(x* — 2a)*. We may let (x* — 2tt) equal u. 'riieii y — m|; 
dy/du == Now differentiating the expression for which 
u stands, viz,, (x* — 2a), with respect to x, we have du/dx =•• .'lx*. 
Taking the product of these two derivatives, but. substjt.uting 
the value of the u for the u, we have 




Recourse to this dodge often makes comparatively ciis^ 
differentiations that would otherwise Iwi extremely difli<‘ulf, 
and workers with calculus exercise great ingenuity in discovering 
ways in which to break up expressions into com{)onent fa(;t.or.s 
that are more readily differentiated than the original cuku 
S ometimes an expression is broken up into three or mons factors, 
for evidently 

^ _ dy du ^dt> dz _ _ ^ (Derivative of a funetioit /as 

dx du dv Jz dx of a function) W 


THE DERIVATIVE OF AH INVERSE FUNCTION 
Another roundabout method that sometimes simplifies the 
process of differentiation is to shift temporarily from the necessity 
of differentiating with respect to x and to do the differentiating 
instead with respect to y, then to reach the differentiation with 
respect to x by a second step. By the same process as that used 
in the preceding section, it may be proved that 

1 dx 
dy/dx "" ^ 


*" y~TT“' Hence 
dx dx/dy 
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We may, therefore, differentiate with respect to y (as is indicated 
by tJie fact that the dy occurs in the denominator), then use 
the reciprocal of this derivative the derivative of y with respect 
to X. Suppose, for example, we have the equation: y* = Sx + 4. 
We might transpose and solve for z as follows: 

- 4 _ y2 4 

■“3 3 3 

Differentiating now with respect to y, 

dx _ 2?/ 
dy ” 3 

SiiUH*) as shown above, 

dx ~ dx/dy dz ~ 2y/3 ~ 2y 

Substituting in this last eq\iatiou the value of y from the original 
equation, we have as our derivative: 

dy _ 3 

dx " 2\/£n'T4 


INTRODUCING A NOTABLE CHARACTER~C 
There is a rcmiarkable quantity in mathematics to which we 
must give attention Ix'fore we can proceed further. It is desig- 
nated by the letter e and has as its value ^ the n 

approaches infinity. Let us expand this value according to the 
binomial theorem and through this expansion determine the 
numerical value of e. The reader must remember that 1 raised 
to any power is still 1. 


e M 



1 +n-i + 


n(ft — 1) 
n* • 1 • 2 


. «(n — l)(w — 2) 
tt» • 1 ■ 2 ■ 3 


«(n — l)(n — 2)(n — 3) . 
n« • 1 • 2 • 3 • 4 


But as n approaches infinity the (n — 1), (n — 2), etc., will 
not differ appreciably from n, so that the factors containing 
n’s will cancel out of each numerator and corresponding denomi- 
nator. This wiU be particularly true near the beginning of the 
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series, where the fractions have an appreciable size; and to the 
extent to which it is not true it will force more rai)id convergence 
of the series, since the n factors in the numerator are smaller 
t.bfl .0 the corresponding ones in the denominator. Wo shall 
then have 


e = 1 d" 1 


+ 


1-2 ' 1 


+ 


• 2 • 3 • 4 T 


1 _ 

2 • 3 ■ 4" 


+ 


This series rapidly converges and, while incommensurable with 1, 
has as its correct value to six decimal places 2.718281. To two 
decimal places e may be taken as 2.72. 

If we develop, and then differentiate, the value of e*, we shall 
begin to sec wherein lies the remarkable property of e. 



nx(nx — 1) 

^ n ^ n» • 1 ■ 2 

, nx(nx — l)(nx — 2) , 


Since the n’s cancel out for the same reason as given above, this 
becomes, as n approaches infinity. 


e® = 1 +- a: + 


"2 + 1 


-r- 


3 i 


2-3-4 




Let us now differentiate thus with respect to *, indicating tho 
differentiation on the left and performing it on tho right. 

dx ^^l-2^1-2-3^1-2'3-4^ 


But that is just what we had before. If w© should continue 
to take successive derivatives we would always got the same 
thing we had to start with, e® lias, therefore, tho remarkable 
property of giving a derivative exactly equal to the variable itself. 
This is a property of immense importance in higher mathematics. 


THB DEMVATIVE OF A LOGAIOTHM 
We are now in position to develop a formula for the derivative 
of a logarithm. Since logarithms are treated in practically all 
texts in algebra, except some of those intended for a single first- 
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year course, we shall assume here that the reader is already 
familiar with them or that ho will take occasion at once to go 
to a textbook in algebra to learn about them. A logarithm is a 
power to which a certain number, called the base, must be raised 
in order to give another irumbcr in which we are interested. 
Thus the power to which 10 must be raised in order to ^ve 100 is 
2; hence 2 is the logarithm of 100 to the base 10. The power to 
which 10 must be raised to give 247 is 2.3927; hence that is the 
logarithm of 247 to the base 10. But in calculus we seldom use 
the bjjse 10; we use c instead, bocau.He of the remarkable properties 
we said above that it pos.scsses. However, logarithms to the 
bjiae f ol«‘y in every respect preci.scly the same laws as those with 
which the reader is, presumably, already familiar with the base 10. 

Now for the derivative of a logarithm. Wlicre v is any func- 
tion of X, let y = log, V. Wc shall carry this through the four 
fundamental steps through which we carried earlier processes 
of differentiation. 


(1) y + Ay - log, iv -h Av) 

Subtracting original c(}uation, 

(2) Ay = log, (e + Av) - log, v 

It is one of the principles of logarithms that tho log of one 
quantity minus the log of a second equals the log of tho first- 
quautity-divided-by-the-second. Hence (2) becomes 

Ay = U)g» 

Dividing by Av, 


An) Av 




We may multiply and divide the right-hand member by v without 
chan^ng its value. Hence 


Aff 


Av 


log, 




But anything of the form 6 • log u may, according to the laws of 
logarithms, be written log «*. Hence we may write 




Ay 


hoJ. 


1 + 
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The quantity in parentheses is of the form 



Now that 


is a familiar expression. We mot it in our precodinK section. 
Where the n is supposed to increase to infinity, it is precisely our 
old friend e. If we lot Av approach zero as its limit, the, (exponent 
v/Av will approach infinity, as it should to make our expri\ssion 
in parentheses equal e. Also, as Av approaches zero !i.s it.s limit, 
At,/Av will become dy/dv, and wc shall have our dfsrivutivc 


^ _ 1 
dv V 


log 4 e ' 


But any log of its own base is 1. Hence log, c = 1 and wo Iiavo 

^ i 

dv V 


But dy/dz == dy/dv • dv/dx. Hence 

dx V dx V 


Remember that wo started with the equation y «= log, v. Putting 
this value for the y in our differential equation, wo have: 


d(loge v ) _ dv/dx 
dx V 


(Derivative of a logarithm) (7) 


The derivative of a logarithm to the base c of any function of 
® is, therefore, the derivative of that function divided by the 
function itself. Take the following concrete example: 

y = a:® 4- 4® — 8. 

<f(log y) _ d(a;^ + 4a: — 8) ^ 1 ^ 

dx dx »* + 4® — 8 * »* 4- 4» ~ 8 


THE DERIVATIVE OP A POWER FORM 
In this case we have shifted our ® function to a place where ifc 
would seem to be very difficult to get at — to the exponent. Let 
a be any constant and u any function of ® to which a is raised as 
a power, and let h be any coefficient of the a“; f.c., lot y ■» fca". 
Taking logarithms to the base e of each tdde of this equation 
(heritor it is to be understood that our logarithms are always 
taken to the base e without our writing the e as a sulMcript), we 
have 

log y » log (a“) 4* log 6 -» u Ic® o + log 6 
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Transposing and solving for u, 


u = ^ 

log o log a 


= log y 


1 

log a 


Iog& 

log a 


Wo shall now differentiate w'ith respect to y. Since a is a con- 
stant, 1/log a is a const.ant and will reappear as such in the 
derivative. Likewise log 6 is a constant, and therefore log o/log h 
is a constant. But, since this constant is independent of y, its 
derivative is zero, so that it will disappear from the derivative 
of the whole <‘xpre.ssion. Remomb('r i.hat, as shown in our last 
section above, the derivative of the log of a quantity is the 
derivative of the quantity divided by the quantity, and notice 
that dy/dy = 1. 


^ ^ \ log a) __ d(log 6/log a) _ . 1 . 1 

dy ~ dy ~ dy ~ dy y log a 

= 1 . -i- 

y logtt 

Uinlor our topic, Derivative of an Itu’erse Function, we showed 
that 

^ _ I ^ 
du ~ dii/dy 

Therefore 

^ 

du XUy) • (l/log o) ^ 

But our original (iquation was y = 6a“. Ihiplacing the y above 
with this value from the original equation, we have 


du 

dx 




ik . . — 

du dx 

(Dcrivativo of a power fonn) (8) 


Therefore the derivative of a constant raised to a power which 
is a function of x is the constant raised to the original power 
times the log of the constant times the derivative of the x function 
that constitutes the power. If additional constants appear as 
coefficients of the one involving the x function in its exponent 
but not themselves raised to a power involving x, these coefficients 
recur unchanged in the derivative. 
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y = ^ = 20«**-=*’+*'> • (2.0957) (3*2 - 4x) 

CbX 


The 2.9957 is the log of 20 and the (3** - 4x) i.s the d<'rivative of 
the original exponent. The derivative is a general ('xpression 
for the slope of the curve y = for any value of x in 

which we may chance to be intcresl,('d. Suppose we wish to 
find the slope of the curve where x = IJ. By substituting in 
the above differential expression, we shall find that, dy/dx is 
precisely zero where * ('(juals l-J. That is, the line, is pnnnsc'ly 
parallel to the x axis where * = 1^. 

We have an especially simple case in this fornuda v/hvm the 
constant is e. This occurs so frequently that it will pay um to 
derive a general rule involving it. We need only put c in place of 
a in the generalized case treated above. 



c“ log c 


dx 


But since we arc working with logarithms to the Inrse c, log it 
equals 1, since any log of its own base is 1. Thercjfon^ 

a: •— (Derivative of the power fonn «“) (9) 

dx dx 


If the function u should be simply x, the derivative would take 
a still simpler form, as follows: 


die-) 

dx 



1 


If 


Thus we come back again to the queer and important fact that we 
discovered when we first mot this quantity c, a few pages back, 
viz., that, when wo dififorentiate c* with respect to ®, wo get as our 
derivative precisely the same thing we had before differentiating. 


MORE PRACTICE m APPLICATIONS 
After we had covered our first round of the simplest forma of 
differentiation, we paused to get some practice and to apply our 
techniques, so far, to finding maxima and minima. Now that we 
are through a second major cycle, let us again pause to make some 
applications. This time we shall take a fairly complicated funcK 
tion with which to work, but one that plays an extremely impor- 
tant part in social and educational statistics. The reader will 
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need to watch his step in order to follow the process. But no 
new principles arc involved beyond those treated in the preceding 
few sections. Indeed it is characteristic of calculu.s that its 
principles arc simple but that its challenge consists in finding 
ingenious methods of analyzing the functioirs in question so 
as to put them into forms that are familiar; and in following out 
algebraic processes that sometimes become a little complicated. 
The function on which we shall practice here is the equation for 
the curve of a normal distribution. We shall later loam that 
this important statistical formula is 


y = 


N 

erV^ 


-.21 

e~2ir> 


whei’o N is the number of cases in the distribution, ir is 3.1416, v 
is a constant for a given distribution with which the reader is 
either already familiar or soon will be, y measures the height of 
the vertical ordinate at successive values of x, and x measures 
along the horizontal axis in terms of deviations from the mean of 
the whole distribution as origin. The meanings mentioned for 
these symbols are, of course, the ones customarily attached to 
them by mathematicians, and we are defining them here merely 
for the benefit of the lay reader. 

An inspection of our equation will show that it is of the form 
y » fee", for which form the derivative was given in our last 
preceding section. The N/isfs/^) is the constant that corre- 
sponds to fe and the — xYZer® is the u. In order to save complica- 
tions in our notation wo shall carry along fe for the complex value 
for which it stands. We shall rewrite the equation and then 
proceed with its differentiation. 

y B= fee 

whence 


MW 



-hX 

(First derivative of the normal an 
curve function) ^ 


hx this expr^on farthest to the right the e with its negative 
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exponent could be transferred to the denominator by making its 
exponent positive, on the general principle that a'-” = 1/aK 
Figure 7 shows the normal curve. The reader should giv(\ him- 
self some practice in interpretation by to.st.ing the signiliennee 
of the above derivative with reference to it.. R('m('ml)ei' that. 
i,he X distan<ie.s are measured fi’om the m<'au (c(nii<*r) of t he <lis- 
tribution as origin, plus to the right and minus to the h'ff.. 
According to the derivative, the slope should bti plus (f.c., up) 
on the left side of the curve when^ x is mimis, for hert^ w(’ have 
minus times minus values of x which shoukl give plus. l>o<‘s the 
behavior of the actual curve conform t,o l,hat (haluet.ion from the 
derivative? On the right side of the curve the slope should ho 



negative (downward), for hero wc have minus times plus values 
of X. Does inspection of the curve bear that out? If wo sub- 
stitute ® = 0, wo should have dy/dx — 0 , for obviously the 
curve is horizontal (i.e., has a slope of zero) at the muldh! of 
the distribution. Try substituting zero for x in the derivative, 
and see whether dy/dx turns out to bo zero. Conversely, wo 
should be able to make up our minds that wo wish to find the 
place where the slope should bo zero and to find it by setting tho 
derivative equal to zero and solving for x. Let us try. 

dz ^ ^ 

Clearing of fractions, then dividing through by —b, 

-6® SB3 0; therefore « «• 0 

Thus we deduce from the derivative that tho curve should be 
parallel to the x axis at the middle of the distribution, where 

iU 8» 0, 
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Wc mi^ht have divided our derivative equation by —bx 

X* 

instead of multiplying through by the crH^\ We would then 
have: 

z^ = o--A- = o 

cr*c^’ <r“e^’ 

taking reciprocals, 

— 1 
== J = 00 

Dividing through by <r“, 

^ oo -21 

eZ'* = — = 00 ; log (c^') = log 00 = 00 ; — (log e) = « 

Since log e = 1, a:*/2o'* = » ; 

— 00 . 2(X^ = 00 J X = 00 

Thus the curve should become horizontal again at plus or 
minus infinity, as well as where x equals zero. Does inspection 
of the curve make that, plausible? 

If wo take a second derivative, wo shall have an expression 
for the rapidity with which the slope of the curve itself is chang- 
ing with successive values of x. See whether you can verify 
the following as the derivative. For convenitmee we shall repesat 
the first derivative, then proceed to take from it a second deriva- 
tive. The reader must remember that we have the following two 
principles involved: wo have the product of two variables and 
we have the form c“. If necessary he should turn back to the 
discussion of the differentiation of these two forms. 


diV 

dx* 


dy —bx 




h(x* — <r*) 

_ N (®* “ ff*) (Second derivative of /■ns 

17^ P — ® . the normal function) 



28 


STATISTICAL PROCEDHIIKS 


By substituting in this expression different V!ilu(\s of x, we 
could find the steepness of the slope for any vahu* of x w(‘ choose. 
If we set the second derivative equal to zero, wo shall find (.he 
value of X at wliich the change of x is a minimum. Let us try. 

rS = 0 

or* 


-£! 

Dividing through by be 

*2 _ g.2 _ Q. J.2 a- g.2. 3. _ 

So the point at which the curve is nearest a straight, line is 
exactly one <r each direction from the mean. That is (.!»> point, 
where the curve stops bending inward and begins hemling out- 
ward. Remembering that the whole distance from the mean 
to the place wo have cut off the curve is alxmt, 2.5ff’s, does <»ur 
finding look plausible? Try dividing through, by t lu' eoefticient 
of e, and see whether you can find ano(,h(!r point, at which the 
change of slope is a minimum. 

If the reader has the necessary hardihood, ho might try, on 
his own, to take a third derivative. He should fin<l it to be 

dzy _ Nx{i<T^ — ap (Third dorivativo of the /«o\ 

dx^~ (T^y^ “ normal function) 

This is an expression for the rapidity with which t.he change 
of slope is itself changing for various values of x. If the reader 
will set this derivative equal to zero and solve for h(! cati find 
that point in the curve where it is bending most rapidly-- where 
the tail begins rapidly to thin. If he wishes to verify the fact 
that at this point the speed of the bonding is a maximum and 
not a minimum, he may take a fourth dorivativo and assure him- 
self that at this point the value of the fourth derivative is negative 
in sign. 


THE DERIVATIVE OF A SDJE 

In the applications of calculus to statistics as presented in 
this volume we make no use of differentiation of trigonometrio 
functions. Nevertheless, because this plays so large a part in 
the full treatment of the calculus, we shall carry the reader 
through one development— “just for fun.” If he does not care 



A LITTLE CAI.CUIAIS 


29 


to follow for the sake of getting a glimpse into this part of the 
calculus, he may skip this section. We shall find the derivative 
of the sine of an angle of value x. We go through our customary 
four steps. 

y = sin x; (1) y + Ay = sin (x + Ax) 

Subtracting the original equation but merely indicating the 
subtraction on the right, 

(2) Ay = sin (x + Ax) — sin 'a: 

In trigonometry the formula is established that 

sin A — sin B = 2 cos i(A + B) sin ^(A — B) 

The A may stand for our (x + Ax) and the B for our x. Apply- 
ing this theorem, we have 

Ay = 2 cos 4- Ax ■+• a:) sin ^(x + Ax — x) 

. n f , Ax\ . Ax 
Aj/ = 2 cos I X 4- 1 sm -y 

Dividing both members by Ax and rearranging the position of 
the 2 in a manner that will not change its effect upon the value, 
we have 

(3, + 

We shall now lot Ax approach zero as its limit. As Ax 
approaches zero, the first factor on the right of the equation 
approaches cos x, for the Ax/2 approaches zero and drops out. 
The second factor in parentheses expresses the relation of the 
sine of an angle to the angle itstdf. But, if the reader will 
visualize the relation of an angle to the sine of tho angle, ho will 
see that, as tho angle becomes smaller, its sine becomes smaller. 
It can be proved that the ratio of an angle (measured in radians) 
to its sine approaches 1 as a limit as the angle approaches zero 
as a Hmit. As the limit is reached, therefore, the whole of the 
quanfdty in the second parenthesis would become 1 and we 
would We 

^ ■■ cos X * 1 n COS X (Derivative of a sine of an angle) (13) 
as 
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Thus the derivative of the sine of an angle is l.ho cokIuo of l,hat 
angle. Differentiation of the other trigonometric funct,ion.s 
proceeds in a similar spirit. 

PARTIAL DIFFERENTIATION 

It frequently happens that a function contain.s two or inoi‘<^ 
variables that are independemt of one another; •// = /(t, z, w), 
so that the total behavior of y is dcptiud<int upon f.lus aggn'gah'd 
effects of all the three faotora upon which it. depcinds. Since 
these factors are ind<‘pc'ndont of one another, we may fm<l the 
differential relation of y to each term in sucicession by different ia(.- 
ing with respect to it, while treating the othin’.s as eon.sfants. 
Thus in the case of y = fix, z, w), wti may diffi'renliate first, 
with respect to x with z and w regarded a.4 constants, then with 
respect to z holding x and w constant, and finally with respect 
to w holding x and z constant. The total derivative would 
then bo the sum of these partial ones. This process is called 
‘partial diffarmtiation. Its several processus are identical in 
procedure with those of simple differentiation. However, we 
employ a different symbolism. Several different symbols are 
used, and out of them we shall choose those of the type* DJ, 
the X standing for the variable with respect to which wis are 
differentiating. Lot us take an example. 

y = X® + 2z* — 3» + z — 6 

Differentiating first with respect to x while holding z constant, 

D4 « 2x - 3 

Next dSfferentiating with respect to z while holding x constant, 

D4 » 6z» + 1 

We shall apply this process of partial differentiation to a 
practical problem. A farmer wishes to make a zinc-lined tank 
to hold 62.5 cu. ft. of water. In what dimensions shall he make 
it so the amount of zinc reqtiirod shall be as little as posaible? 
That is, with what dimensions will the sum of the areas of the 
bottom and the sides be a minimum? 

Let X equal the length of the tank and y its width. Then 
the area of the bottom will be xy. The volume is the area of 
the bottom multiplied by the depth, since we are taking the 
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tank to be a rectangular parallelepiped. That is, if d is the 
depth, 

62.5 = dxy, or d = 

xy 

The total surface {S) is the sum of the bottom surface plus 
that of the two sides phis that of the two ends. Therefore, 


a 

S 


ry + 2x 


62.5 

xy 


+ 2y 


62.5 

xy 


, 125 , 
X2/ + Y- + 


125 

X 


For conveuioncc in differentiating this cnay be written, 


S ^ xy + 1252/“^ + 125a;’’^ 

Now the surface is a function of both the length and the width, 
and these two are independent of each other. We shall, there- 
fore, resort to partial diffex'cntiation, first holding x constant 
while we diffi'rentiato wit.h respect to y, then holding y constant 
while we differentiate with respect to x. 


Dyf - X + (^l)(126r^) 

= y + (-1)(125®“*) = 2/ - 


The (S is to be a minimum by reason of the effect both of the 
length and of the width. Therefore each of the two partial 
dcrivative.s must lie equal to zero. Making them so and solving 
the equations we get, x — 125/y® = 0. Clearing of fractions, 
and transposing, xy* = 125. Similarly y — 126/»* =» 0, so 
that x*y = 125. Since each is equal to 125, x*y = xy\ Divid- 
ing through by xy, we have x = y. Substituting in x*y — 126, 
we have x* » 125, x = 5. Similarly y* = 125, so that y = 6. 
Thus the surface of the tank is at a minimum for the volume 
in question when the tank is 6 ft. long, 6 ft. wide, and Sfi ft. deep. 


mXBQRAXION 

So far we have dealt with the process of differentiation, which 
involves determining the relation of ininitesimal increments of 
one variable to injBnitetimal increments of another. The second 
part of calculus, as customarily treated, deals with ii/degraM<m. 
This is the reven^ of differentiation; it involves having in 
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hand a derivative and wishing to get back from it to the original 
function. At first sight it would seem that this should be easy; 
we would need only to retrace the steps that would have given 
us our quantity in hand as a derivative. That is precisely true. 
All we need to do in the process of integration is to recall what 
type of function gives us, when we differentiate it, a derivative 
of the typo exemplified by the one we have in hand, then put 
down the original function as our needed integral. Only, it 
sometimes requires great ingenuity to rccogniz<3 our qiumtity 
as a type of derivative with which wo have dealt. Groat ingenu- 
ity is exercised by mathematicians to put quantities, by algebraic 
manipulation, into forma that are familiar as derivatives. 

The symbol of integration is /. You customarily see it in 
such form as this: ^fix)dz. This / is really only an old form 
of the letter s, and the indicated integration may be thought of 
as summing together the infinitcHimal increments represented by 
dx the number of times indicated by the remainder of the expres- 
sion, in this case fix) times, whatever that fix) may stand 
for. Let ua take first our simplest cases. If we differentiate 
y — x\ we got dy/dx — 4«®. If, therefore, we aro given tho 
expression fix^dx and are told to integrate it, wo, understanding 
that that command involves the order to get back tho function 
which if differentiated would give it, might guess that 

/4**d» ss 

We could have obtained this by raising tho exponent of the 

by 1, making a fraction out of I over this increased exponent, 
and multiplying the coefficient of tho quantity to bo integrated 
by this fraction. Thus 

J ixHx = 4a:<»+» « 

That, you see, is exactly the reverse of what we do when wo 
differentiate an expression of this type. For when we differ- 
entiate, we dimmish the exponent by 1 instead of increasing it, 
and we multiply by the original exponent instead of dividing by 
it. So integration is the reverse of differentiation. Let us ttUce 
the more general case, and, treating it for the present just as w« 
did above, see what is involved in going from the function to tho 
derivative and then back again to the function. 
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y = ax"", ~ = OTKS’*-' 

J* dy = J* (.anx’^^)dx = ^ a;n-i+i _ gj.. 

Our rule, then, for integrating a function of the form ax’* 
seems to be to increase the exponent of the x by 1, raising it to 
(n + 1), and to multiply the coefficient of the x by l/(» + 1). 

But let us remind ourselves of the behavior of an independent 
constant. Differentiate y = ax’* + b: dy/dx = anx’‘~K Inte- 
grating this by the above rule we get 




(07lX”~‘)dx = 


an 


(n - 1) + 1 


3;n— 1+1 _ qjjh 


The b which belonged to the original function has been lost. 
That will not do. As a matter of fact, when we integrate, we 
can never know whether or not there should be in our integral 
an independent constant. So we take no chances; we add a 
constant, calling it C. If, then, the C turns out to be of zero 
value, its inclusion has at least made us safe. This C is called 
the coTisiani of integration and should always be added when 
integrating. So our full integral of the above function would 
be 

fdy = /(onx""*)dx = ox" + C 

BeoaU, now, how we differentiated y = ox" -1- bx** -|- cx« d: 

^ = nax"~* •+• pbx»*~‘ + qcx*~^ 

Going back from this derivative to the original function we 
would have 



no 


1 ■+• 1 


X" -f- 


pb 


1 + 1 


x” + 


qc 


1 + 1 


X® “1- C 


But each of th(^ parts is precisely tihe integral of the correspond- 
ing part of the function being integrated, so that we have 

fdy - /nox^-'dx -I- fpb3t»~^(ix + fqcx^'^dx -i- C 

In other words, the integral of the sum of any number of func- 
tions of X is the sum of the integrate of thoira functions. 
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We shall have now a few simple exereises in intc'gration, so 
far as we have yet carried our principU's. Wo shall complot.e 
SOUK! of them and leave ot,hors for the reader to <iompl('tc‘. Note 
that a (lx accompanies each, which indicaix's (,he variahlc wiih 
respect to which we are l.o integrate. 

jdx'Mx = + <7 

J7x dx = + C 

J(3x2 - 3)dx == x“ - 3x + (’ 

/(Sx‘ + 6x» - dx-)dx = Jx» + ix* - 3x» + C 
/8x»dx = 

/(Sx* — 4x)rfx = 

/ (x'’ -I- 4x + 3x" -)dx — 


Stanoaki) Inteqhau Fokms 

It is unnecessary for us to take up for dcitailed dincu-saion 
each of t.hc types of functions as W'c did under differontintion. 
It will be enough to place in a list, below, a few (huivatives on 
the left and their int,egrals on the right. The re.adcr will recog- 
nize that, if the diffeniutiation of a certain typ<^ of function 
yields a certain type of derivative, then, by reiwon of (,lie meaning 
of an integral, the integration of the type repriwnted by tho 
derivative will yield tho integral function. Mathematical 
workers depend heavily upon such lista of standard integrals, 
referring to them to find tho typo involved in their problem and 
from this writing out tho integral. If nothing has over b<'<‘n 
differentiated that yields a particular type of derivatives, then 
it is impossible to integrate that typo of function— of which, 
however, there are very few in applied mathematics. Full 
texts in calculus, as well as some books of mathematical tables, 
give extensive lists of standard integral forms, while wo ipve 
below only a very few. 


J 

J 

J 

/ 


dx « 

uHu 


x^G 

ti + 1 
a’* 


log a 
e*dx « e* + C 


+ C 
Hh C 
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Area under a Curve. — ^There are a number of applications of 
tho integral calculus to two of which we shall give particular 
attention at this time. Tho 
first of these is finding tho area 
under a smooth curve of which 
the equation is known. 

Let u be the area bounded 
by the curve of which the 
equation is y « or*, by the a 
axis, the fixed ordinate DC, 
and the variable ordinate MP> 

Evidently as the distance CM varies the area CMPD will vary. 
That is, as r takes on an increment, the area u will take on an 
increment ; so that « is a f unotiion of x. Inspection of the diagram 
will show that 

Am MNBP < area MNQP < area MNQ8 
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But area MNRP is equal to MN times MP, and area MNQS is 
equal to MN times NQ. The MN is a variable distauet! i.o 
be added to CM which wo may call Ax, and the art'a MNQP 
is a variable area to be added to u which we may call Aw. Mak- 
ing these substitutions we have 

MP ■ Ax < Au < NQ ■ Ax 
Dividing throxzgh by Ax we have 

MP <NQ 

If now wo let Ax approach zero as a limit, Aw/ Ax will become 
du/dx, MP will approach NQ as a limit, and this limit will Ixz y, 
the vertical ordinate of the curve at the point under consideration. 
Thus in the limit, du/dx = y. 

But fdu = M. Therefore fydx — fax^dz *= u. 

This shows that we can got areas under a curve by integrating 
the equation of the curve. 

But, since x has successively different values, wo must always 
find the integral up to a certain value of x. When we substitute 
a value for the x, wo have the area under the curve from the 
origin (zero) up to that point. If we desire to find the area 
between limits neither of which is zero, we shall need to find the 
area up to the higher limit, then to the lower limit, and to take 
as our required area the former minus the latter. This we do 
whether the two points between which wo desire to integrate lie 
on the same side of zero or on opposite sides; the process of 
algebraic subtraction will take proper care of signs. 

Let us use again our curve on page 13 and suppose wo can 
have no negative y values. The limits of our curve will then 
be X «= 0 and x »= 8, and wo want to find the total area under 
the curve between those two limits. Our formula for the curve 
was y » 8x — x*. The integral of this is 

Jy dx * /(8x — x*)dx •• 4x* — lx* -f (7 

Substituting for x its upper limit value x ■■ 8, we get 

4x* - |x» -t- C » 4 ' 64 - I • 512 + C - 266 - 170| + C 

-851 + C 
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We must now substitute for the lower limit, which is a: = 0. 
But, when we substitute zero for z, we get for our integral 
merely C. Subtracting the upper value from the lower one, the 
C’s cancel out so that our whole area is 85J. 

Suppose we wish to find the area of this curve up only to 
whore x *= 3. We substitute 3 for x in the integral and get 

4-3®-'J-3* + C = 36-9 + C = 27 + C' 

When we substitute zero for x, we get merely C in our integral, 
taking the difftTcncc iK'tweon the values at these two limits, we 
have (27 -f C) - C = 27. 

Suppo.so we wish to find the area of the curve between the 
points whore x - 5 and where x = 6. 

Sx.6 ^ ~ C 

= (4 • 6* - 4 • 6’ + C) - (4 • - i ■ 5» + C) + 0 - C 

= (72 + C) - (SSi + C) = 13f 

The C disappears in the process of subtraction. The C always 
disappears when integrat ing between limits because always there 
is involved subtraction with the C appearing in both minuend 
and suhtrahond. 

^ The B<iuetio& of a Curve, — The second application of integra- 
tion is in finding the eciuation for a curve when the slope of the 
curve is known. Thus, in developing the formula for the curve 
of a normal distribution we first obtain an expression for the slope 
at any point, x. How shall wo get from this information the 
equation for the curve itself? If wo had the equation of the 
curve, we know that wo would need to differentiate it in order to 
get an expression for its slope. Obviously, •Uxerefore, if we have 
the expression for its slope, we need to employ the converse 
operation of integration in order to get the equation for the curve. 

There are other types of appUcation of integration, such as 
finding the length of a curve or the area between curves, and 
many of the type that involves summing elements that approach 
aero in size but of wlucfa the number bears a reciprocal relation 
to the dze. Such typMi as finding the length of a curve or the 
area between curves would deserve elaboration here except for 
tile fact that for our present purpose we do not need to draw 
upon them. For the type that involves summing iafiniteamals 
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into a whole, we shall have considerable use, but the application 
follows so obviously from the basic meaning of integration as 
not to require discussion. We take occasion at a point of 
application in our chapter on Measurement of Variability to 
develop the important Taylor series, and consequently refrain 
from developing it here. 


Integration by Parts 


A device to which mathematical workers often re.sort when 


direct integration is difficult is int,<'gration by part.a. You 
remember that, when we differentiated a product, we got the 
following: 


djuv) 

dx 


u 


dv , du 
dx ^ dx 


f 


By transposition wo may write this 


™ _ d (vxi) ^ 
^ dx ~ dx ^ dx 


When integrated this becomes 

Ju dv = /d(wo) — du 

But fd(uv) is equal to uv. Therefore 

Judv = «» — /vdw (14) 

In order to show how we may employ this combination of 
parts where we cannot integrate directly, lot us take the follow- 
ing example: Jdy = /x«*da!. We may take u » x and dv ■« (fdx. 
Then du = dx and /dv — v *■ /e®dx. But we know tho integral 
of d^dx; it is simply a*. Substituting all of these values in our 
Eq. (14) above, 

fxe^dx w xe* — e* =» (x — l)e* -f- C 

We may sometimes integrate by parts several times in succeMion 
or may employ the formula resulting from the product of throe 
or more factors instead of two as illustrated in this example. 

SucoBSsrvE Intbqhation’ 

Just as it is possible to differentiate a number of times in suc- 
cession (“partial differentiation”)* so it is possible to int^Erate 
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any number of times in succession, either with respect to the 
same variable or with respect to different variables. In the case 
of those functions which are commonly encountered in practice, 
we can integrate in any order we please where we are integrating 
each time for a different variable, just as was the case with 
diif('reutiatioii. The expression at which we have arrived at 
the climax of any process of integration constitutes the point 
of departure for the next integration. No new principles arc 
involved, although usually expressions become more complicated 
with added stops in successive integration. 



CHAPTER II 

MEASUREMENT OF CENTRAL TENDENCIES 
PREVIEW OF STATISTICS 

The General Nature of Statistics. — Tho nUidi'ni. Hhould rt'iilizo 
from the beginning that there is nothing magi(‘al or oeenU, or 
especially difficult about stalistica. The itisk td' the Htatiaticuil 
worker is merely to doHfU'ibo siUMunetly a std, of ineasurenu'Hfrt 
or ‘'variables,” or the relations bet, ween seds of variahies. As 
long as wo have only small numbers of <iases wii.h whi<'h t.o <h'ul, 
wo can get along very well by deseriliing them one !>.y one, or 
our comparisons pair by pair. Wo may say about a group 
of three boys, for example, that John weighs 112 lb., Sam 12.'}, 
and Charles 135. Wo may say, further, that (Uiarh's weighs 
more than Sam in spite of the fact that th(! f(»rmer i.s okier. 
But if wo have 1,000 boys to de.s(U'ib<', or 100, or <'ven 20, w« 
cannot talk about them tlius oiu' by one; to do so wotild reejuiro 
too much time. Wo are obligetl, therefore, to atiopt somo 
more compact method of descri}>tit)n that will tell tiu» truU» 
succinctly, yet do justice to the grouj). So wt^ (l(‘seril>e the weight 
in terms of an average and an expression for variability, and tluj 
closeness of relation b(!tween weight and ag(! in terms of a 
cooflSicient of corrtilation. 

The Tasks of the Statistician. — In giving an mh'tjuate deserijj- 
tion of a mass of quantit.ative data, w<i shall muKi to do oii(‘ or 
another, or several, of the following things: 

1. Mention some representative number to indicate the general 
size of the variables — ^a mean, a median, a mode, or other ind4>x 
of “central tendency." The popular term for this is “avesrage." 

2. Indicate how widely the variables are spread — how much 
they differ from one another. As measures of such variability 
we have average deviation, range, percentiles, etc. 

3. Show the shape of the distribution. The frequency 
polygon resulting from the distribution of variables may be 
rectangular, or bell-sliaped, or skew. If bell-shaped, it coay be 
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liighly ppiikcd up in the middle (leptokurtic), or rather flat 
(plat.ykurtie), or moderately peaked (mesokurtic). Measure- 
inen(.s taken in connection with time trends, or summated 
measurenumts, may fit parabolas, or sine curves, or other types 
of regular or irregular trend curves, and we may wish to measure 
the goodness with which these curves fit the data. 

4. Bhow l.he rtilation of two or more sets of valuables to each 
oth(!r. Where we wish to show the relation of the sets to each 
other as wholes, we may indicate the percentage of overlapping 
or the tUfferenc.e. betwt'on the means or the comparative variabili- 
ties. Where we wish to show the degree of parallelism between 
t,lw? corresponding measurements in different distributions, we 
may resort to coefficients of correlation. 

5. Indicate how di’pendablo our generalizations are (our 
means, standard deviations, coefficients of correlation) by 
showing liow much they must be expected to change with further 
sampling. This is the problem of reliability. 

6. Translate the variables with which we are working into 
forms t,hat have a standard meaning, just as people long ago 
eamo to translate measures of distance or of weight into a few 
standard forms such as foot, meter, pound, or gram. 

The whole of applied statistics is comprehended under the 
above six types of functions. The student will do well to 
keep the details of his work in statistics in this perspective. In 
this cliapter wo shall discuss the first of these tasks — measuring 
central tandencios. This has to do with giving a picture of the 
geneml size of the scores (the variables). There are several 
ratmHuroa of central tendency which wc shall take up in turn: 
arithmotie moan, median, mode, geometric mean, and harmonic 
moan. 


THE AlUTHMBtIC MEAN 

Definition and Fomola.— -The mean is that point in a distribu- 
tion of scores around which the moments* are equal. It is well 
pictured by a seesaw. The fulcrum of a seesaw must bo so 
placed that the moments on one side exactly balance those on 

> Hers we are employing the tenn moment in the sense in wMeh it is used 
in physios in oonneotion with rotary momentum. The term is also used 
is a different and more teohnioal sense in statistics to designate the power 
to whiidt deviathma are raised befesre aven^^ tihem. 
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the other. The mean is popularly called the avtragp, aliliough 
in technical statistics the term average is <nnployed for any 
measure of central tendency. 

The reader has doubtless long thought of the mean as the stira 
of the scores divided by the number of scores. That is correcl., 
but its truth follows a.s a corollary from the more general (ioncept 
of equalized moments stated above. Wo shall first eoncr('f,t'ly 
illustrate this correspondence and then give a gf'in'ralized proof 
for it. Consider the scries of numbers 17, IS, 8, 7, 4, 4, 3, 2, I, 1. 
The sum of the scorns is 60, the number of scores is 10, and the 
mean 6. Four of the scores are above the mean and six of them 
below. The moments above awi giveji by the deviations of tlus 
four high scores from the mean and are 

(17 - 6) + (13 - 6) + (8 - 6) + (7 - 6) 

« 11 -1-7 + 2 + I = 21. 

The moments below are 

(6 - 4) -h (6 - 4) -f (0 - 3) + (6 - 2) + (6 - 1) + (6 - 1) 

= 2 -h 2 + 3 -t- 4 -}- 5 H- f) « 21. 

Thus the sum of the moments above the mean e(mals lh<^ H\im 
of those below the mean. 

Now for the generalized proof. Let the scor<‘s above the m<*an 
be represented hy a, b, c, d, k and those below by p, q, 

r, . . . , z; lot the mean be M, the numbtir of Hc,{»reH above th« 
mean a an'd the number of scores below the mean t, the whole 
number of scorcis, 8 -f f, being JV. Then, since tho momentn 
around M are to bo equal 

(o - ilf) + (& - iWO + (c - ilf) + • • ■ +(k-M) 

^(M~p) + (M-q) + - + (M~z) 

But the M occuns in tho scores above tho moan s times and in tho 
scores below tho moan i times. We may separate out tho recur- 
rent ikf's and have the following equation: 

(fl -t- 4- c -f • • • +k) — sM 

»« fAf — (p ■+• g -h r + • * • 4* *) 

Transposing, and multiplying both sides of the resultant equa- 
tion by — 1, 

(s •+• t)M ••• + k) 

+ (p + ff + r+ ’** +*) 
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Dividing by (« + <)» 

a + & + c+ • • • + & + p4-g + J' + ■ • • + s 
s + t 

But the numerator of the fraction on the right side of the equation 
is the sum of all the scores, while the denominator is the whole 
number of scores, N. Therefore M, the mean point about which 
the moments above and below are equal, has also as its value 
the sum of the scores divided by the number of scores. We 
may, therefore, regard as equivalent definitions of the mean 

(1) the sum of the scores divided by the number of scores and 

(2) the point in the distribution around which the moments are 
equal. The reader will soon see that the latter is the more 
illuminating definition. 

The Mean of Grouped Scores. — We may hold on to definition 1 
a little longer so as to apply it to grouped scores. In the dis- 
tribution of Table I several of the scores are of the same size. 
The frequencies of thft.so similar scores are shown by tallies in 
column 2 and by Arabic figures in column 3. We could, of 
course, find the mean of the distribution by adding, one by one, 
all the 103 scores, regardless of the fact that there are duplicates, 
and dividing by the number of scores. But wc have available 
multiplication as a foreshortened form of addition; it is far more 
economical to multiply score 9 by 23, for example, and add the 


Tablb I. — Bcorbs in Handwbitino on thb Thorndike Scale 


(1) 

(2) 

(3) 

(4) 

X (scoro) 

/ (frequency) 

f 


14 

i 

11 

2 

28 

13 

nil 

4 

82 

12 

im 1 

6 

72 

u 

xatAur 

10 1 

no 

10 

. mt JMX xtit iiit 

20 

200 

9 

imuit UAtj^ 111 

23 

207 

8 

JU<« -HrHr Mit nil 

19 

152 

7 

immtm 

13 

91 

0 

mt 

5 

30 

5 

1 

1 

5 

Totals........ 


103 

947 


M 9.10 
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product to the other moments than it is to iwid in tlx^ nine 
separately 23 times. We, therefore, multiiply <'a<'h score hy il,s 
frequency, as shown in column 4, then add t.hesc^ products. 
The sum of these moments will obviously be the same as that of 
the scores added separately, and this sum divided by N will 
give the mean. Thus the formula will be'' 


M»= 


S/Z 

N 


(Aritlunetio moan) fl5) 


Mean of Scores Grouped by Intervals. — If our scores are many 
and arc widely spread, wo cannot conveui<'nt.Iy group tlwm by 
individual scores; wc find it more convenient to group tlwin by 
intervals with a range of more thiin one unit. In 'l'abl(( II this 
scores are grouped in intervals with a range of 5 and with fni- 
quoncics shown by tallies and then by Arabic numbt'rs. Interval 
149.5-154.4, for example, contams all the scores that havt^ vahnw 
between 149.5 and 154.499 . . . , just short of 154.5 but not 
including 154.5. All these scores may bo thought of as c(‘ntcring 
around the mid-point of the interval in whieh they fall, which is 
152. Similarly the scores in eatih of the other inh'rvals may 
be thought of as centering aroxmd the mid-points of the intervals 
as shown in column 4 of the table. We may, therefort', get tho 
average of the distribution by multiplying (uich of these mid- 
values by the froquoucy of scores in tho correspoiuUng intervals 
and by dividing by N. Intervals may be of any conveiuent 
length, but wc usually like to make them of such length as to 
give from 12 to 18 intervals for a distribution. A smaller 
number will, however, do little harm when central tembmcics 
are being calculated. A favorite length of interval is five or 
ten score points if this gives a number of intervals nnywht'w 
near what is desired. The interval ought normally to })egin 
with a multiple of its unit of length. Thus, if the intt-rva! is 
three score points in length the initial number of ea(dj interval 
should be a multiple of three. The way in whicli to find tho 
mid-point is to add the initial numbers designating the two 
successive intervals and divide tho sum by two. 

‘ The symbol 2) means that we are to sum the variable following it (fx). 
2 is the Greek capital sigma. Some wiiters in statistics, Mpedaliy those who 
follow recent practice in England, use S instead of 2 as the summation sign. 
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Table II. — Edtjcational Ages ot 109 Pupils Expressed in Months 


(1) 

Educational 

(2) 

Frequency 

(3) 

Frequency 

(4) 

X (mid- 
point) 

(5) 

fX 

179.5-184.4 

1 

1 

182 

182 

174.5-179.4 

111 

8 

177 

1,416 

169.5-174.4 

mr 1 

6 

172 

1,032 

164.5-109.4 


6 

107 

835 

159.5-104.4 

nil 

4 

162 

648 

154.5-159.4 

iWT mf 111 

13 

167 

2,041 

149.5-154.4 

Xm JHH 1 

10 

152 

2,432 

144.5-149.4 

111 

13 

147 

1,911 

139.5-144,4 

XAH JrHrt 





xm 11 

22 

142 

3,124 

134.5-139.4 ! 

X^TJXiriT 11 

12 

137 

1,644 

129.5-134.4 ; 

xm 1 

6 i 

132 

792 

124.5-129.4 

* 111 

3 

127 

381 

Totals 


109 

... 

16,438 


A Mean from a Guessed Mean. — Falling back now on defini- 
tion 2, we recall that the moments above a true mean are exactly 
equal to those below. We might, therefore, find the true mean 
by trying one point after another until we get one that gives 
equal moments on both sides. Of course, no one would do so 
foolish a thing in practice. Nevertheless, odd as it may sound, 
statisticians almost always (unless they are working with a 
calculating machine) approach the calculation of a mean by 
guessing the mean and then correcting the guess by an arith- 
metical adjustment of such sort as to balance the plus and 
minus moments. It is ordinarily much the easiest way. Sup- 
pose the true mean of a distribution is, as the calculator is later 
to learn, M. But not yet knowing this, he guesses the mean at 
M«. Let the amount by which his guessed mean differs from the 
true mean be represented by c. Then, if a: is the deviation of a 
score in the distribution from the true mean and os' is its deviation 
from the guessed mean,^ as » / — c. Summing thq devia- 

>T%e term ooaventiooaUy empbyed for a deviation from an assumed 
mean is the Greek letter |. But we are avoiding it because the novice finds 
it HnfamiUfcr ftod difficult to Write. Berides, the best starisUcal practice is 
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tions for all the scores, 

Sa: = Sa:' - Sc 

But c is the same for each of the N scores, and Sx (the sum of 
the deviations around the true mean) is, by definition of a mean, 
equal to 0. Therefore, 

Sx' - iVc = 0 

Transposing and dividing through the equation by —N, 


The amount by which the assumed mean missed the tria^ nu'an 
equals the algebraic sum of tlu^ tleviations from the assumed 
mean divided by the whole number of scores. 'I’hus we may 
guess a mean at any point wo phiase, oomptito the deviations 
from this point summed and dividesd by N, and a<l<l this <niuti(*ut 
to our assumed mean to got the true mean. Our formula is, 
then, 

M = + C Mg + -jy ■ (Mean from a guesHcd mean) (16) 

Application of the Formula. — This procedtire may he applaal 
to grouped or to ungrouped data. Let us consider first ungnmped 
data. Suppose you are finding the moan of grad<‘H for your edass 
as listed in your record book. You may look th<im over in a 
general way and decide upon a suitable om^ as a guttsstHl nuHtn. 
Then begin at the top of the column and add mentally (alge- 
braically) the deviations of the scores from this assumod moan, 
divide the excess by the number of studonts, and add this 
quotient algebraically to the assumed mean. The result will 
be the true mean. 

When scores arc grouped, as in Tables 11 and III, the principle 
is equally applicable. Let us take the more complex case, 
Table III. We assume a mean anywhere we please, say at the 
raid-point of interval 146--149. We always set the assumed mean 
at the mid-point because we want to regard the measures in the 
several intervals as centered around the mid-points. We must 


to reserve Cheek letters for “trae" values, sod this use doM not oome in that 
class. 
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now take the deviations from this assumed mean and multiply 
them by their corresponding frequencies. Each measure in 
interval 150-154 deviates +5 from the assumed mean, each in 
155-159, + 10, etc. But let us not carry along these big numbers, 
5, 10, etc.; let us work in terms of intervals. Everything cen- 
tered about the mid-point of interval 145-149 deviates 0 interval 
from the assumed mean, everything about the mid-point of 
interval 150-164 deviates 1 interval from the assumed mean and 
in the other intervals by the number of steps indicated in colunan 3. 


Tablb III. — Educational Ages op 109 Pupils Expkesbed w Months 


(1) 

Educational ago 

(2) 

/ 

(3) 

»' 

(4) 

/*' 

180-184 

1 

7 

7 

175-179 

8 

6 

48 

170-174 

6 

5 

30 

165-169 

6 

4 

20 

160-104 

4 

3 

12 

155-169 

13 

2 

26 

160-154 

16 

1 1 

16 

145-149 

13 

0 

0 

140-144 

22 

-1 

-22 

136-139 

12 

-2 

-24 

130-134 

6 

-3 

-18 

125-129 

3 

-4 

-12 

Totals 

109 


4*83 


c - - 0.76. 0.76 X 5 - 3.8. Jf - 147 -f 3.8 - 160.8 


We compute our moments as in the earlier exercises of this 
chapter and algebraically sura them according to the formula. 
But when we have found our c, it is in intervals, since that is the 
unit with which wo have been working. An interval is, in our 
particular problem, 5 scores wide; hence a c of 0.76 interval equals 
a c of 3.8 score points. Add this correction to our assumed mean, 
147, and we have 160.8 as the tmo mean, which is the same as 
we got before. Our formula is, thus, 

M^M, + 

The / in the formula is merely a “symbol of operation”; the 
formula would mean exactly the same if it were not there. 
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The /merely indicates that we have foreshortened our additions 
by resorting to multiplication by frequencies wherever there were 
several scores of the same value. 

The worker will find the guessed moan method a very con- 
venient method. It is customarily called the short m<Aod. 
Not a bit of accuracy is lost by it.; the mean will (.urn out to ho 
precisely the, same no matter where the guassed m<«in is taken. 
In fact the method of finditig a mean by adding the, scores and 
dividing by N may be regarded as a form of guc'ssed-mcan 
method, the assumed mean being at zero. 

The Meaning of a Score ; Discrete versos Continuous Series. — 
When wo compute means wc are confront.ed wit.h a difficulty 
about the meaning of scores. What does 6 mt'an? Does it 
mean just 6 or anything from 6 to a trifle short of 7? Or drwss 
it mean from 5.5 to 6.5? When there are 6 boys in a <’row<i 
there are just 6 and no fraction. Similarly a gun hjis fired just 6 
times, a student has finished just 6 problems, a player ha.H hit 
the ball just 6 times. But if a boy is reported to be 6 years old, 
that may moan anything from 6 to a trifle short of 7, <»r it may 
mean approximately 6— anywhere hetw(^en SJ and just short 
of The same is tnio of 6 miles, 6 hr., 6 lb, — when* tins n'port 
is so crude as to mention only whole numhers. Some data must 
be measured in terms that necessarily involve only whole num- 
bers; there cannot in the nature of the cose bo fractions. Such a 
series of measures is said to bo discrete. Other data involve no 
real bireaks; each degree passes by infinitesimal gradations into 
the next. Such scries are said to bo continuous. 

Now a discrete number should afford us no difficulty when 
computing a mean, except that the moan itself must he regarded 
as merely symbolic. Each number is exactly what it purports 
on the surface to be — a 6 is 6.000 and nothing else. Wo may 
add these numbers as they stand, divide the sum by N, and have 
an unequivocal mean. But if the measured series Is continuous 
and our reports are crudely put in whole numbers, then our 
numbers must all be taken as stretching through a whole unit. 
Indeed the same thing is true even when we give our measure- 
ments in terras that add some decimals; the last decimal covers 
a stretch through the unit of its order. Our confusion is made 
worse by lack of uniformity in indicating the direction in which 
this mnge spreads from the value named. In some oases Ihe 
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score named stands at the mid-point of the range designated by 
it — eight years old means nearer eight than any other whole 
number, somewhere between seven and a half and just short of 
eight and a half. At other times the score stands for the value 
just across the lower margin — eight years old means from 
just eight to barely short of nine. With the former moaning, a 
number of eights, such as one would find in a frequency table, 
would tend to average exactly eight; but in the latter meaning, 
the average for the group would tend to be eight and a half. 
Evidently our metisures of central tendency of a distribution ol 
scores will give us different results under the two interpretations. 

Both Kelley and Holzingcr recommend that, unless the 
evidence in the data clearly indicates otherwise, we take all 
numbers in the former sense — as standing at the mid-point ol 
a range from a half unit below to a half unit above. Thus S 
would cover from 7.5 to just short of 8.5 and 163.796 would covei 
163.7955 to just short of 163.7965. That,, then, involves taking 
roughly given numbers at their face value. But it affects the 
limite of intervals in a frequency table and makes necessary s 
form of tabulation different from that customarily advised ii; 
most of the elementary textbooks on statistics. For ar 
interval must start where the range covered by a number starts 
a half unit below the designated number. For purposes ol 
tabulation it Is safest to indicate the limits of the intervals in s 
way that makes this clear, as illustrated at the left below. How- 
ever, if only whole numbers are involved in the tabulation (o] 
whole units in respect to the digit farthest to the right in th< 
interval designation), no confu.sion can occur from the simple] 
tabulation illustrated at the right provided one uses the correcl 
mid-point and remembers when computing a median that the 
interval begins a half unit below the value indicated by the initia 
number designating the interval. 


( 1 ) 

Correct Way to Designate 
the Limits of Intervals 
When Number at Mid-point 

19.5- 24.499 

14.5- 19.499 

9.5- 14.499 

4.6- 9.499 
-0.6- 4.499 


( 2 ) 

A Simpler Form of 
Designation Usually 
Satisfactory 
20-24 
16-19 
10-14 
6- 9 
0- 4 



50 


STATISTICAL PROCEDITRKS 


If, however, the context clearly incUoa(.('.s that the inimher 
stands for a range at the lower margin of whi<‘.h it is pla,(*<'(l, ihis 
meaning should bo followed in the tabulation, the mid-point 
should be determined accordingly, and tlio interpolation (which 
we shall shortly find to be involved in the ((oinputution of a 
median) should take as the beginning of tlu( interval the value 
of the initial number rather than a half unit below that value. 
This is the method to which the reader has probably alrtiady boc'n 
introduced in the more, elemenUry books on statistics. Its 
interval limits may be indicated by either of the two following 
methods; 


( 1 ) 

Correct Way to Designate 
the Limits of Intervals 
When Number at Ijowcr Margin 
20.-24.999 
15,-19.999 
10.-14.999 
5.- 9.999 
0.- 4.999 


( 2 ) 

A Simpler Form of 
Designation Usually 
Satisfactory 
20-24 
15*^19 
10-14 
5 - 9 
0- 4 


In this latter case the mid-point of the interval can most 
easily be found by taking half of the sum of the initial numbc'w 
of two successive intervals, and the same i.(‘chni<iut! will holt! 
for the arrangom(!nt on the h'ft in the forinttr cas<!. But for 
the arrangement on the right in the former case we must obtain 
the mid-point by taking lialf the sum of the inititU and final 
numbers designating the limits of uu interval. 

If this latter method (customary in most elementary texts) 
is used in finding a mean from a fnsquoncy distribution, the mean 
will not tally with that obtained by adding the individual scores 
and dividing by their number unless either the mean obtained 
from adding the ungrouped scores is increased by 0.5 or that 
obtained from the frequency table has been diminished by 0.5, 


THE MSDIAH 

Meaniiig. — ^The median is the mid-point in a distribution— tho 
point above or below which lie an equal number of cases. Note 
that, while for a mean the mometUs above and below must be 
equal, for a median the number of cases above and below must be 
equal. These two conditions are not identical except in a 
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perfectly symmetrical distribution, and sometimes the mean 
and the median of a distribution may differ from each other 
considerably. 

Computing a Median. — For the computation of a median the 
scores must be arranged in regular ascending order according to 
size, or at least they must be thought of in such order. Our 
median lies halfway up through the series; i.e., -IN units from the 
beginning of the scries. Suppose \vc have the ungrouped scores 
2, 4, 5, 5, 7, 8, 8, 9, 9, 9. The number of items is 10, so that we 
must use up 5 scores — go to the end of the fifth score — for the 
median. The end of the fifth score is the upper limit of score 7, 
the vahie of which is 7.5. It happens that the next score in the 
series, 8, begins at 7.6, as stated above, so that to locate the 
median at 7.5 puts just half the scores below and half above. 
But if there had been a gap (say the next score had been a 9), 
wc would make a rough adjustment by placing the median at the 
mid-point between where score 7 leaves off and where s(!orc 9 
begins; that is halfway between 7.5 and 8.5, which Is 8.0. If 
the number of items is odd, the median will fall at the middle of 
the range of the digit and will have the value fc.O, where k repre- 
sents the mid-score. But medians in small samples arc usually 
very rough statistics, and we cannot afford to be very finicky 
about such nice adjustments as have just been mentioned. 

We may illustrate the computation of a median from grouped 
data by Table III. Wo accumulate our frequencies up through 
as many intervals as we can without exceeding -J-iV. When wc have 
reached the bottom of an interval that, if included, would more 
than exhaust wo interpolate within that interval to locate 
our point; i.e., we place it such a proportional part of the distance 
through the interval as the cases yet remaining from iN bear 
to the whole number of cases in the interval. 

In Table III, = 54.5 scores from the beginning. 

3 6 “1“ 12 -f" 22 43 scores, 

which carries us to the beginning of the interval 145-149. 54.5 — 
48 »■ 11.6 score points yet to go. Since the total frequency in 
this interval is 13, we must go 11.5/13 of the distance through the 
interval to find the median. As we have interpreted the mean- 
ing of scores here, the lower margin of the interval lies at 144.5. 
Therefore, 
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= 144.5 + 4.4 = 148.9 

Mid -score versus Median. — If one is seeking the middk' s(!oro 
of a series, the formula for finding it is 

- , AT 1 

Mid-score = — ij— 

Thus, if there are 13 scoras in a si'ric's, t.he middle siiore is the 
seventh one, which would bo found from the (?xpro.ssion 

(13 -1- l)/2 = 7. 

At first sight it would acorn as if there are 6 scorns above the 
seventh score and 6 below and that the seventh shoukl, therefore, 
be the median. But there arc six sciorcs lielow xt'hvrv Ihv mu'idh 
score begins and 6 above wlurc the siwenth ends. Th<^ mid-He,on' 
is, thus, a saddleback that stretiihes through an appreciable 
interval. The median, on t,he other hand, is a point, in the dis- 
tribution that separates the upper 50 pi*r eimt, of the scores from 
the lowiT 50 per cent. This point is halfway bed, ween the open- 
ing value of the sevi'iith siiore and its closing valu(>. What 
these end-values are, if strictly interprek'tl, should be determined 
according to the principles laid down in tin; paragraph abtive 
regarding continuous vcivtus dise-ri'to scu'ies. However, in prac- 
tice, since a median from ungroiUK'd data is a very rougli meas- 
ure, wc ordinarily t,rcat our mimlKW as if th<*y were diserete--- 
as if the mid-point of score 7 were just 7. I’lie statistical worker 
will seldom wish to deal with mid-scores in contrast with meilians; 
htmoe ho will have little use for the formula for mid-scon* given 
above. 

THB MODE 

Meaning. — The mode is the score that occtirs with the greatest 
frequency. To use it as a meastm* of central tendency is to 
employ a standard analogous to the determination of group 
evaluations by moans of a plurality vote. In crude statistical 
work we pick out the mode merely by inspection. In fact we 
seldom employ the mode in psychological and educational sta- 
tistics in any more refined form than this rough inspeotional 
one. But there are more precise methods for finding the mode 
if one’s problem justifies paying the price of employing them. 


Mdn. = 144.5 + 
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One of those more precise methods is to “smooth” one’s dis- 
tribution by averaging the frequencies in adjacent intervals and 
continuing thus to average until the irregularities of the distribu- 
tion have been sufficiently ironed out to make one interval 
stand out in frequency above the others, which interval will 
then contain the mode. Of course, if the distribution is bimodal, 
peaks will appear at two places, or more than two if the distribu- 
tion is multimodal, and the smoothing process dare not go so far 
as to cover up legitimate multimodality. The most precise 
method of dealing with the mode involves, however, the use of 
higher mathematics. It re- 
quires dotorminiug the equation 
of the bcist fitting curve and 
calculating the value of the x 
variable in the equation for that 
cuiwe when the y variable is at 
a maximum. In Fig. 9 the 
frequency polygon of a set of 
scores is indicated by a broken 
line and the bo.st-fit curve by a 
solid line. The equation of this 
curve has been found to be, we 
shall say, y = Bx ^ xK Now, 
to find the mode, we must find 
the place along the X axis where O—Frequonoy polygon and curve 
the y will have tht^ maximum 

value. To do this, wo differentiate^ the equation and set the 
derivative equal to zero. Thus differentiating, we obtain 
8 — 2a! = 0, or » = 4. Tho mode is, therefore, exactly at the 
point where a; = 4. 

Although the inspectional mode is the orudost of our measures 
of central tendency, the mathematical mode is the most easily 
detjerimned with exact precision when once we have the equation 
for the curve of our distribution. Most empirical distributions 
will, of courst!, reciuiro best-fit curves with much more complex 
equations than the above hypothetical one, but we have been 
concerned merely to give the reader a glimpse as to how a 
mathematical mode is computed. The practical worker in 
our field of statistics will have little or no occasion to compute 

‘ See preceding chapter on Calculus, pp. 10-16. 
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modes matlicmaUcally for empirical distributions. If one did 
have such necessity, he would probably wish to resort to a ready- 
made scheme that Karl Pearson has worked out, which would 
give good enough results for most purposes. By using the sort 
of procedure described above, he found (.hai. the mode of his 
“typo III curve,” which is reprc.sontativc of a wide variety of 
moderately skew curve.s, is given by the following formula: 


Mode == mean 


mean_^ median 
c 


where c, although differing slightly for different dist.ribut.ions, is 
given approximately by the following equation: 


c = 0.3309 


0.0846(iW - Mdii.)* 
Mdn.)* 


in which <r is the standard deviation of the distribut,ion--a 
mea.sure we shall discuss in our next, chapter. It i.s obviou.s that 
the numerator of the fraction in this last equation will hi? very 
small compared with the detvominator; henei? the whole fraction 
will have a value .so small that it may bo neglected, c will, there- 
fore, e<iual approximately 0.33, which is about i. Substituting 
i for c in the basic equation above, wo have 


Mode = Jlf - 3(M - Mdn.) 


(Mode computed from 
th« mean and the (17) 
median) 


Thus the mode of a distribution may bo computed from a 
knowledge of the mean and the median. 


Other Measures ok Central Tendency 

Geometric Mean. — Two other measures of central tendency 
are^ used occasionally, though little in our tyim of research, 
which we shall notice in passing. One of those is the geomotrio 
mean. It is used whore the successive terms differ by a constant 
ratio instead of by an addend. It is the mean, therefore, of an 
exponential series. Growth in school population in the United 
States from 1900 to 1926 illustrates fairly well such a series; 
the numbers attending increased with a fairly constant accelera- 
tion, 80 that the trend line depicting the numbers curvra con- 
tinually upward, like that of money at compound interest. To 



MEASUREMENT OP CENTRAL TENDENCIES 


55 


find the geometric mean, we must take the Nth. root of the 
product of our measures. Thus 


G.M. = • X2- Xi • • ■ Xtf (Geometric mean) (18) 


But ordinarily the only feasible way in which to compute a 
geometric mean is by the aid of logarithms. 

log G.M. = ^ (log Xi + log *2 + log Xs + • • • + log Xy) 


The geometric mean gives us the value a score would have 
midway through the scries if it wore actually located on the 
exponential curve determined by the average rate at which the 
scores are increasing. The mid-score is, thus, located on a 
uniformly inflected curve while the arithmetic moan is located 
on a straight lino fitted to the measures, if the scores are arranged 
in successive order as to size. When* the values arc greater than 
unity and positive, the geometric mean is always smaller than 
the arithmetic mean, as a comparison of the straight and curved 
lines mentioned above would indicate; and no meaningful 
geometric mean can be computed if one of the scores is zero. 
To the extent to which the series of scores is irregular instead of 
exhibiting a systematic positive or negative acceleration, to that 
extent a geomotric mean would lack pertinency and meaning.^ 
The Harmonic Mean. — The other measure of central tendency 
to come in for slight notice is the harmonic mean. It is the 
reciprocal of the mean of the reciprocals of the scores. Its 
formula, by definition, is 


H.M. 


T7i;i+i+ 

Jy \Ti 

N 


2 1 

X 


+ 


N J^x 

(Harmomo mean) (19) 


This formula is properly employed where the data are given 
in a form that beam a reciprocal relation to a more significant 

> A good elementary disouseion of both the geometric mean and the 
harmonio mean, with many iUustrationB, can be found in J. E. Wert, 
EdueaiioncA Staiktkt, MoQxaw-Hill Book Company, Ino., 1988, pp. 63-80. 
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and meaningfvil measure. Suppo.so, for example, data arc given 
in terms of the number of problems pupils solved in aji hour, 
while the number of minutes recpiired per problem is bclitncd to 
be the more straightforward measure. The harmonic mean 
would then be the one to use. The reader will find a gootl discus- 
sion of the conditions under which to use the harmonic mean 
in an article by Forger.^ 

Validity of tiik Assumptions in Oomputino Mkans 

AND MKDIANS FUOM CJUOUPIOD DaTA 

In computing a median from groupisl data one assumes that 
the measures in the interval in whiiih this miidian lies are ('(jually 
di.stributcd through the interval; hiiiuio the point may be loeatetl 
by interpolation. In computing a mean, one assumes tba(, i.he 
measures in each interval are centered about tlu^ mid-point of the 
interval. These assumptions are seldom fulfilled in praeliee. 
If the reader will observe the curve of the normal dist.ribution 
in Mg. 10 below, he will notice ihat the freiiuencios in the several 



Fio. lO.—Norrnal dintrihution and “tmposjoidur' 


intervals make figures that are approximately trapezoids (except 
the middle one, which makes a double trapezoid). In order to 
fulfill the assumptions these figures would need to be r<‘ttl.a«igIeH, 
or other symmetrical figures. The mean of a traI«^zoid is not 
located at its mid-point but somewhere near the longer side. 
Hence, when the point around which tho scorcss of an interval 
center is taken to be the mid-point of the interval, it is taken as 
farther away than it really is, and tho moments are, in conse- 
quence, all too large. But in a perfectly symmetrical dlatribu- 
laon this distortion corrects itself. For the curve behaves 
identically on the two sides, so that an excess of plus moments 

‘FaaaHiB, Wieth F., /. Amer. SuaisHcd Ame., VoL 26, pp. 86-40 
(Marohi 19^1), 
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on the one side is exactly neutralized by an excess of minus 
moments on the other side. It is also obvious that the median 
is not displaced in a symmetrical distribution on account of 
the “trapezoidal” shape of the interval, because at the critical 
position the curve is practically flat and the positive slope of 
the lower half of the mid-interval is precisely balanced by the 
negative slope of the upper half. But to the extent to which 
the disli'ibution loses its symmeti’y, as all empirical distributions 
do, to that extent the assumptions about the distribution of 
scores within an interval lose validity. But the error from this 
cause is likely to be small. 

Another condition somewhat invalidating the assumptions is 
lack of uniformity of distribution within the intervals, due either 
to small sampling or to some selective factor. If the number of 
cases in an interval is small, it is unlikely that they will make 
either a regular rectangle or a regular “trapezoid”; their mean 
will be cri'atic aixd .seldom exactly coincide with the theoretical 
mean of the interval. Hence means calculated from grouped 
data arc likely to differ somewhat from those calculated from the 
raw scores and also to vary somewhat as intervals are changed 
in length or in placement, and the more so to the extent to which 
the number of cases is small. In consequence the data should 
never be grouped into intervals involving a wider range than one 
unit, unless there arc at least 40 cases. 

lOven if the number of cases is large, there is the possibility 
of irregular distributions within the intervals by reason of a 
schictive factor favoring certain scores. Thus percentage 
grad<!s are likely to .show local modes at 70, 75, 80, 85, etc. The 
remedy in such case is to select the limits of the intervals in such 
manner that these modes come at the mid-points. But, of course, 
that principle could not legitimately be followed at the expense 
of keeping tlie intervals of uniform width. 

Exercises 

Table IV contains data suitable for practice by any students for whom the 
computation of tho various measures of central tendency has not yet boon 
sufficiently automatized. This table will be drawn upon also for exercises 
in connection with later chapters. It is, therefore, advised that the student 
preserve the distributions set up in the exercises of this chapter (and the 
statistics derived from them) for use on those later ocoasions, so as to fore- 
stall the necessity of making them again. 
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Table IV.— Scorejh Made in Five Divisions of Tim CAUNBcm Foun* 
DATioN Test fou College Students, TooETimii with Intelligencb 
Test Scoues and Cuade-point Avbhages at IOnd of College 

CUttKEH 

(Girls arc lahcUul 0 and boys H) 


Pupil 

LiUt- 

aturc 

Knji;liBh 

total 

Matho- 

imitics 

Sci(‘nc(‘ 

History 

and 

s(>(4ai 

studit^s 

(lonoral 

intolli- 

Final 

Krado- 

point 

avnrrt|j;o 

B 

47 

105 

46 

49 

38 

56 

M9 

B 

51 

103 

55 

58 

82 

7H 

Ml 

B 

43 

155 

27 

80 

45 

53 

L2t 

0 

42 

154 

97 

52 

20 

92 

1 H3 

G 

84 

224 

46 

72 

54 

111 

i.4r> 

0 

80 

254 

56 

too 

97 

126 

2.27 

0 

78 

223 

30 

97 

1 55 

114 

1.75 

G 

43 

149 

34 

78 

23 

71 

1.56 

0 

53 I 

no 

115 

61 

i 50 

74 

1,71 

a 

60 

148 

51 

. 94 

36 

87 

1,72 

B 

1 

70 

172 

19 

106 

69 

S3 


B 

46 

155 ! 

127 

78 

6H 

95 

2.80 

0 

30 

126 i 

75 

1)5 

56 

73 1 

1.81 

0 

93 

259 

84 

82 

78 

tis 

1.71 

B 

101 

247 1 

65 

104 

111 

114 

2.17 

a 

50 

163 ’ 

21 

80 

35 

74 

1.02 

a 

84 

200 

60 

75 

35 

109 

l.Ol 

0 

65 

170 

58 

58 

47 

07 

1.71 

0 

72 

239 

45 

85 

10 

08 

1.86 

a 

01 

235 , 

61 

64 

85 

134 i 

2.07 

0 

100 

300 

43 

90 

123 

130 1 

2.04 

0 

63 

163 

52 

91 

55 

78 i 

1.64 

B 

07 

206 

112 

118 

41 

113 

2.05 

B 

112 

279 

43 

93 

137 

102 ! 

1.80 

0 

66 

178 

21 

74 

32 

90 

1,61 

0 

69 

184 

46 

91 

54 

103 

1.79 

6 

83 

205 

54 

118 

60 

96 

1.1ft 

G 

63 

181 

41 

71 

10 

96 

1.42 

B 

79 

253 

62 

129 

56 

116 

1.88 

G 

84 

268 

61 

87 

132 

102 

2.81 




MEAwSUREMENT OF CENTRAL TENDENCIES 59 

Table IV. — Scores Made in Five Divisions of the Carnegie Foun- 
dation Test for College Students, Together with Intelligence 
Test Scores and Grade-point Averages at End of College 
Career. — (Continued) 

(Girls Are labeled G and boys B) 


Pupil 

Liter- 

ature 

English 

total 

Mathe- 

matics 

Science 

History 

and 

social 

studies 

General 

intelli- 

gence 

Final 

grade- 

point 

average 

G 

42 

142 

48 

83 

30 

72 

1.52 

B 

51 

187 

30 

39 

42 

98 

1.21 

G 

70 

209 

125 

87 

54 

103 

1.60 

a 

89 

272 

48 

107 

72 

134 

1.89 

B 

95 

244 

92 

141 

239 

142 

2.03 

B 

56 

137 

47 

85 

11 

75 

1,21 

G 

90 

226 

67 

114 

58 

82 

1.96 

Q 

81 

221 

55 

125 

72 

110 

1.45 

G 

04 

177 

57 

108 

38 

102 

1.75 

a 

84 

197 

43 

04 

44 

03 

1.76 

B 

114 

256 

70 

106 

106 

100 

1.37 

0 

94 ! 

273 

54 

128 

105 

123 

1.74 

G 

08 

213 

67 

77 

0 

112 

1.29 

B 

75 

233 1 

33 

98 

110 1 

90 

1.24 

G 

91 

293 ! 

70 

98 

84 1 

140 

2.61 

B 

03 

108 

48 

87 

70 

90 

1.04 

a 

08 

205 

66 

59 

74 

99 

1.58 

B 

52 

124 

67 

122 

77 

79 

1.25 

a 

74 

153 

44 

91 

40 

115 

1,96 

G 

34 

128 

16 

63 

38 

87 

1.01 

B 

68 

273 

55 

in 

79 

83 

2.25 

B 

56 

213 

155 

138 

44 

131 

1.77 

0 

32 

171 

55 

51 

36 

78 

1.18 

0 

64 

166 

67 

81 

52 

94 

1.45 

a 

20 

72 

70 

107 

40 

SO 

1.12 

G 

87 

258 

152 

107 

60 

110 

2.06 

G 

41 

196 

25 

54 

63 

73 

1.76 

B 

67 

227 

30 

78 

68 

116 

1.44 

G 

66 

193 

79 

99 

47 

90 

1.69 

B 

66 

156 

89 

111 

78 

70 

1.08 



Cs; ^ Q O Ci 


00 


ST AT US1' I CAL PE0( ^ KD t r RIOS 


Table IV* — Scoues Made in P'ive Divisro^w or the Caknmhik Fohn** 
BATioN Test for Collkhe Students, Touktuer with lN*rEHHi<JKN<'E 
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Career*— {Coni in itrd) 

(Girls are lal)clc(i G and l)oys R) 





















MEASUREMENT OF CENTRAL TENDENCIES 


61 


Table IV. — SroRBS Made in Five Divisions of the Caunegib Foun' 
DATioN Test for CotiLEGE Students, Together with Intelligence 
Test Scores and Grade-point Averages at End op College 
Career. — (fiontmued) 

(Girls are labeled G and boys B) 


Pupil 

1 

Liter- 

ature 

English 

total 

Matlic- 

matics 

Science 

1 

History 

and 

social 

studies 

General 

intelli- 

gciico 

Final 

grade- 

point 

average 

B 

38 

165 

1 

48 

138 

126 

85 

2.47 

0 

61 

212 

46 

141 

68 

101 

1.79 

B 

03 

275 

i52 

191 

1 134 

148 

1.08 

B 

5v5 

156 

48 

76 

93 

102 

1.59 

G 

1 82 

268 

72 

107 

115 

126 

2.20 

G 

69 

188 

36 

120 

79 

86 

1.89 

B 

84 

185 

10 

68 

63 

82 

1.44 

B 

54 

153 

121 

111 

81 

102 

1.23 

G 

; 95 

219 

38 

109 

24 

77 

1.45 

B 

49 

184 

39 

118 

58 

68 

1.46 

<7 

35 

122 

48 

07 

137 

73 

! 2.00 

B 

28 

127 

15 

80 

69 

110 

! 1.13 

0 

14 

141 

40 

61 

11 

99 

1.22 

0 

63 

.173 

47 

112 

59 

78 

I 1.88 

B 

07 

236 

79 

138 

186 

131 

2.10 

0 

77 

i 

107 

52 

88 

62 

125 

1.88 

0 

04 

273 1 

54 

128 

105 

123 

1.74 

Q 

68 

213 

67 

77 

4 

112 

1.29 

G 

34 

128 ' 

16 

63 

38 

87 

1.01 

B 

56 

213 

142 

138 

44 

131 

1.77 

G 

64 

166 

67 

81 

62 

94 

1.45 

G 

87 

258 

152 1 

107 

60 

110 

2.06 

B 

67 

227 

30 

78 

08 

116 

1.44 


From Table IV compute the means of ono or more of the columns by 
the adding-machine method; is., by summing the individual scores and 
dividing by the number of scores. 

% Confirm this mean by assuming a mean and then correcting for oKcess 
moments, taking the scores severally. 

3. Group the scores of one or more of the columns into frequency dis- 
tributions, and compute the means. Try intervals of various lengths, and 
compare the mean in each case with that of Exercises 1 and % 
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4. Compute medians from the distributions of Exoreise 3* Compare 
means and medians. Try to account for any diflorences obw^rveti. 

5 . Determine the mode for the distributions of Exorcise 3. C'*omparo 
moans, medians, and modes. How does Pearson formula for <u)mp\iting 
the mode from the mean and the median hold out in these trials? 

6. The following table gives the number of pupils attending ptihlic high 
schools in the United States by 5-year periods from 1880 to 1025 and the 
ratio of the number at each period to the number at the proooding period. 
What is the most appropriate measure of central tendency It) take for these 
data? Compute it. 

Tablb V, — Numbeh of Pxn»i)LB ArrsiNniNO Pitblio Huui Benoons in thm 
United States fhom 1880 to 1925 


Year 

No. of pupils 

Ratio of t‘ach p(‘- 
riod to pn^vious 
period 

1880 

1885 

110,227 

160,137 

1.453 

1890 

202,063 

1.267 

1895 

350,099 

519,251 

1.725 

1900 

1.483 

1905 

679,702 

1.309 

1910 

915,061 

1.346 

1915 

1,328,984 

1.462 

1920 

1,857,165 

1.397 

1926 

3,065,009 

1.650 


References for Further Study 

Feiioeh, WiETH F., ‘*On the Use of the Harmonic Mean/^ J. Atrur. 

tical Assoc., Vol 26, pp. 3(M0 .(March, 1931). 

Pbahbon, Kabl: ^‘Bkew Variation in Homogen<H>UH Material,'' ^Vuns. 

Boo, (London), Berios A, Vol. 186, pp. 343ir.; and Vol. 197, pp. 443^459. 
(The formula for mode in terms of mean and median.) 



CHAPTER III 

MEASUREMENT OF VARIABILITY 


Our preceding chapter dealt with formulas for finding some 
representative number with which to describe the general size 
of the scores of a distribution. In this chapter we shall take 
up formulas for expressing the degree of scatter in the scores — the 
extent to which they arc grouped closely about the central 
tendency or spread widely from it. Just as was the case in 
dealing with central tendencies, we may have two types of 
measures for variability — measui*cs in terms of moments and 
measures in terms of the location of points. The former include 
average deviation and standard deviation; the latter include 
such measures as range, percentiles, quartile range, and many 
other interpoint ranges. We shall treat first the measures of 
variability in terms of moments. 

AVERAGE DEVIATION 

The method of measuring variability likely to be most familiar 
to a layman, or to seem most reasonable to him when mentioned, 
is average deviation. This involves merely subtracting each 
score from the mean and finding the average (mean) of the 
deviations thus obtained, algebraic sign being disregarded. 
The formula is, if a; represents the deviation of a score from the 
mean and the enclosing lines indicate that these deviations 
are to be taken without regard to algebraic sign, 

A.D. - ^ (20) 

If tibe data are grouped into a frequency distribution, the »’s 
■will merely be multiplied by their respective frequences before 
bdng added. If the deviations are taken in intervals rather thmx 
in scores (the former is the proper vr&y), the A.D. mil be in 
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intervals but can easily bo changed (lO sciores by muKiplying by 
the width of the interval. The whole formula will, then, be 


A.D. 



(Averago deviation from /onn'\ 
the mean) t*suaj 


This simple formula answers very well if the number of items 
is small or if the mean happens to be a convenient whole' number. 
But if the mean contains decimals, the number of digits involved 
in each subtraction process, and in the summation pnxH'ases, is 
likely to bo inconveniently large. It is thtm most convenient 
to take the deviations from some nssunuid mean that is a wliole 
number and to make a correction to atone for th(^ error that wouhl 
otherwise be introduced, lad, c lx* tlu^ diH(,an(!(^ from the iisHum('<l 
mean to the true mi'an. Then, if x is the deviation fnnn tin; true 
mean and z' the deviation from the assunu'd mean in the case of 
any score, the x for <ia(!h score above t.he true nu'an will he |a;'I — c, 
and that for each score bidow tlu' tme mean will be jx'l -j- a. Ia*t 
us use the suhseript I to nifttr to scores Ixdow the tnni mc'an and 
g to refer to those above tlm true mean. We shall then hav«! the 
Allowing: 

Sla-„I = Sla:Jl - f^c, and = 2:|x{| + /ic 

Adding, 

2)(%1 + 21x4 = 2|xl = Slx'l + (/i “ /u)'? 


Dividing by N, 


A.D. 



S>1+ 

~''N 


< 21 ) 


As in finding a mean from a guessed averag<?, the a = lSx*/N, 
i.e., the sum of the deviations about the assumed menti tUvidtKi 
by the number of cases. Normal account must bo taken of tho 
algebraic sign of the c. 

If the data aro grouped in a frequency distribution, deviations 
should be taken in terms of intervals rather than in seores, each 
z' should bo multiplied by tho proper frequency when adding, 
and the whole fmetion must be multiplied by tho length of tho 
interval to get back to scor^. Thus the formula bocomos 

A.p. - m± . V Lzi^i (US) 

m ammed mean) 
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Each score that is greater than the true mean by no matter 
how little counts among the /„’s, and each that is less counts 
among fi’s. In a frequency distribution all the scores of a given 
interval count among the /,’s or the fi’s, according to whether 
the mid-point of the interval is above or below the true mean by 
no matter how little. Why this is true an examination of our 
formula will disclose. 

It is important to note that the above formulas can be used 
only when the assumed mean differs from the true mean by less 
than one unit (or loss than one interval). This is because other- 
wise there would be between the assumed mean and the true 
mean some deviations that do not use up the whole of the c. 
If the guessed mean with which one has started turns out to differ 
from the true mean by more than this, one must start again with 
a mean that fulfills this requirement, unless he wishes to make a 
somewhat complicated adjustment for the omitted c units. 

Assumed Mean at Zero. — One can escape the limitation stated 
ip the preceding paragraph by assuming the mean at zero, in 
which case all deviations become merely the scores themselves. 
The resultant formula is then of general application besides 
having some other advantages, particularly if one is working 
with a calculating machine. Let X represent any score and M 
represent the mean. Then each deviation above the mean will 
equal X — M, and (uich deviation below the mean will equal 
M — X. Our summed deviations will then be 

Z|x„l = - /„M, and S|a:,| = fiM - SZ, 

Adding, 

Sjxl = (ZJ, - SX:) -b 

Dividing through by N and then making a rearrangement, 


A.D. » + 

{SX - 2SXi) + (ft - /.)M 

w 


(Average devi- 
ation in terms 
of raw scores) 


(23) 


By formula (23) the computation of A.D. with an adding 
machine is very easy — perhaps the easiest of all the variability 
measures. Without even taking the trouble to arrange the 
scores in order of magnitude, one merely sums them on the 
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machine to get iJA' and N and thence 'SX/N = M. Then lie, 
goes through the set of seon's a second time, running in all Uie 
scores which are, less than M to get and /j. Seori'S whic.h 
exactly equal tdie moan, if any, may cither be counted among 
the Xi or among the X„. 

If we arc dealing wil,h a frequency dist.ribut ion rather than 
with scores, we may work with i,ho actual mid-jioint. values, in 
which case the formula holds just as above (fnaim'iieies in the 
intervals being, of course, taken accounti of). Or we may work 
in terms of intervals insti'ad of score values, i.h(>u multiply by the 
length of the interval at the end of the process so as to g(‘t back 
to score values. For this purpose we may number our intervals 
in any way we please. But in this latter case we must, n'plaeo 
the M of the formula hy C, which as usual equals 21/A’/iV. Our 
formula will then he written 


A.D. 


■ 


- S/A'j) + (/, ■ 

"N 

22:/A'i) + ifi 

- 


mi 


(.\vi‘nigc* lio- 
viation in 
a fr<^(iu<‘ncy 
table) 


(2afl) 


But sinee the M in the case of single scores wouUI also he found 
by the formula ^X/N, just as is our C, this lust formula in either 
of its shapes is of general application. For if t.he tlata are indi- 
vidual scores, the / in each summation is 1, and the i is 1, so 
that they may ho ignored as factors in actual operative prtx’-essi's. 
This is a particularly aseful formula when working with a 
calculating machine. One needs only sum tlm whole st'ries, 
divide the sura by N, then go back and stim again t.he items 
that have values less than the, 'HfX/N in order to get the 2XfXi, 
the ft, and thofg demandtsd in tlie formula. 

Average Detdation from a Median. — An average deviation can 
be taken from a median, or from any of tluj other (H'ntrnl tend- 
encies, by precisely the same techniques as from the mean. 
Usually, however, point measures of variability rather than 
moment measures will be employed in connection with a median. 
But it is worth noting that the average deviation is a minimum 
when taken from the median rather than from the mean or 
from any other point. 

We shall illustrate four prooedures in finding the aver^ 
deviation from a frequency drotra>ution. Three of them are 
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variations biised on formula (23a); 1 is in terms of the actual 
values of the mid-points of the intervals, as shown in the column 
headed X ; 2 is in terms of intervals with the numbering beginning 
at 0; while 3 is in terms of intervals with the numbering beginning 
at 1. 4 is based on formula (22). It will be seen that all four 
procedures give precisely the same result. 


Tablk VI. — Illustration op the Computation op Average Deviation 


Score 

Mid- 

value 

X 

/ 

fx 

a;' 

from 

0 

fx’ 

a;' 

from 

1 

fx' 

k'l 

from 

near 

mean 

fW\ 

20-24 

22 

3 

66 

4 

12 

5 

15 

2 

6 

15-19 

17 

8 

136 

3 

24 

4 

32 

1 

8 


12 

20 


2 

40 

3 

60 


0 

5- 9 

7 

12 

84 1 

1 

12 

2 

24 

1 

12 

0- 4 

2 

10 

20 

0 


1 

10 

2 

20 

Totals, . . 


53 

546 


88 


141 


46 


Mean « 10,3. Mean in intervals « 2.06 


646 - 2 • 104 4- (22 - 31)10.3 246.3 , 

1. A.D. -gg => - gg- - 4.63 

2. a.D. - . 5 - . 6 « 4.63 

3. A.D. - + (21r. . 6 - ^6 . 6 - 4.63 

Do Do 


4. A.n. 


49.06 

“63 


4.63 


STANDARD DEVIATION 

Definition. — The standard deviation differs from the average 
deviation only in the fact that the deviations are squared before 
they are summed; then the square root of the mean of these is 
taken. The symbol conventionally used for standard deviation 
is O', the Greek letter sigma corresponding to our lower case s 
— a practice upon which we shall comment in a footnote shortly. 
By definition, the formula for the standard deviation of an array 
of scor^ from the actual mean is 
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Sigma from an Assumed Mean. — It is soldom convcnuint to 
take the deviations from the actual moan, siiuro such dt'viai.ions 
usually involve decimals which arc cumbersonu^ to handle when 
squared. It is much more convonumt to work from some 
assumed mean that will involve only whole numliers. Is't r. ho 
the amount by which the assumed mean diflers from the ael.tial 
mean. Then, if x repre.scnts the deviation from tli(i corrc'ct 
mean and x' tho deviation from the assumed mean, for oiu! 
score, 

X = z' — c, ov x' — X + c 
Squaring this deviation for one item, 

z'‘ = ic® + 2xfi +• c* 

When wo sum for the whole set of score's, the r- will onU>r iis 
many times as there arc items, thus hisioming Nr,-; and tins 
various ai’s, since they arc different, will need to bo represouttHl 
by Sx®. Summing wo get 

21a:'’ = 2Jx* + 2c2:* + iVc* 


But (in the middle term) etjuals 0, since it is the sum of the 
deviations about the actual mean and such sum always equals 
zero. Tho whole middle term will, thcreforo. bocome zero and 
drop out. Wo shall then have 


Sx'* a= XZ^ + iVc* 

Transposing, 

Sx* *= Sx'’ - Nc^ 


Dividing through by iV and substituting aj for "Sx^/N, 


<r$ 


Sx* 

N 


Sx'* 




Sx'* 

-Jf* 


-c* 



{Standard tlnviailon from 
an aesumad maan) 


( 24 ) 


It will be observed that this formula holds absolutely, not merely 
approximately. One need have no hesitation in applying it to 
a distribution of any shape or in taking his assumed me»t any 
place ho pleases. The resiilt will be precisely the same whether 
working from the actual mean or from any assumed mean. 
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Zero as the Assumed Mean. — If the assumed mean is taken 
somewhere near the true mean, the numbers will be smaller and 
the arithmetical work consequently less laborious if done by 
hand. But there will be both positive and negative signs with 
w’hioli to worry, which are somewhat annoying in any case and 
particularly so if one is working with a calculating machine. It 
is often most convenient, especially when working with a machine, 
to place the assumed mean at zero. Then all deviations will be 
positive. Moreover, the deviations will be precisely the same 
as the scores, since each score differs from zero by its whole self. 
And c will be the mean of the scores in an ungrouped series, or 
in any case S/X/iV. The formula then becomes, where X 
represents any score. 






_ 1 (Standard deviation in /<>/</>> 

- ^ - (^X) (24aJ 


The Population Variability. — ^The measure of variability dis- 
cussed above is the standard deviation of the sample of scores one 
has ill hand. If the size of the sample could be increased by the 
addition of further typical scores, the standard deviation woulc 
be slightly increased* As the sample approached the whole 
population in size (the population'' being a theoretical^ 
infinite number of individuals of the kind sampled in the distribu- 
tion wo have in hand), the standard deviation would approacl 
the limit^ as follows: 



^Tho conventional symbol for an estimate of the population varianci 
from a sample is a*, as we have used it* However, best statistical usag* 
reserves the Greek letters for ^Hrue*' values, so that o-* should be used t( 
designate the theoretical population variance rather than the compute( 
variance of the sample. But American practice is so far committed to th 
use of as we have employed it in the early paragraphs of this chapter tha 
we feel it would not be feasible to change at this stage. We shall, therefore 
continue to use cr* for the computed sample variance and, following th 
Pearson School, employ the tilde over <r*, at*, to indicate a theoretical pope 
lation variance. We follow R A. Fisher in using a* for an estimate of th 
population variance. Some other authors use «'* for the population valu 
and for the sample value. 
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It ia somothinR of a nuiaancn to indioaU* aquaro rooi, each t iine we 
wiah to talk about varialalit.y. So the t('rm luniancr ia us < h 1 for 
the atandard deviation squared. Ju this termiiiolony tlui 
estimate of the population variance i.s the Kam{)Ic variance nmlli- 
plied by N/{N - 1). Since <r"' = 2xViVand a'^iN/N - 1), 
evidently 

2 _ (Popalatiou variiuicc ('stimaict! /i>k\ 

~ jy _ j from a Hiuiiple) 

The proof sometimes given for the above formula for tin' esti- 
mate of the population variance is very complicated, involving 
the geometry of hyperspace. But a valid proof is nailly V('ry 
simple. 

Let a: be a deviation from a sample mean and xt a (corresponding 
deviation from tluc mean of the whole population (which is t.ho 
mean of all sample means). Then c, as we have used it abtm*, 
is, for each sample, the mccau of tiiat sample. Thendoro 

Sx* = :Sa-J - NM} 

2x? = + NM} 

Sum for all samples, call them S in number, and divid<‘ by UN 
where N is the number in each sampltn Also consider the or’s 
of the samples sufRcicntly alike to bo treated jis an avt‘rugt‘ (tlui 
straight bar over a symbol denotes it an average and th<! syinlnds 
above and below S dtmote the limits between which sums are 
taken). 

sjv s w a 

r _ r r i r 

‘W " ■■ SN'^ iSiV “ 

orj = + (tJ, 

On page 132 formula (64), we show thato-jj; «■ ^l/N. Making t his 
substitution and performing some simple algebraic operations, 

So if we were estimating the population variance from our 
scores, we would merely divide by (iV — 1) instead of by N. 
If the scores in terms of which we were wtwi^ were devialione 
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from any other point than the actual sample mean, the proper 
adjustments could easily be made; for deviations from some other 
point than the actual sample mean we would have 

(Estimate of the population variance 
sj = — ^ yn “ when deviations m the sample are (26) 
N{N — 1) taken from an assumed mean) 

It is chiefly in connection with formulas for standard errors, a 
phase of theoretical statistics which we consider later, that we 
need estimates of the population variance rather than the sample 
variance. In trying to give a sense of the scatter of an empirical 
distribution for descriptive purposes, it is the variance of the 
sample rather than an estimate of the population variance that is 
customarily employed. But if, in order to make the statistics 
more strictly comparable when the samples are very small and of 
unequal sizes, one wishes to express the variability in terms of the 
population estimate rather than in terms of the sample, one 
should be careful to call his statistic an estimate of the population 
variability and to use the letter s to designate it. 

Sigma from Grouped Data. — ^When scores are grouped into a 
frequency distribution, they are all considered to be centered 
about the mid-point of the interval in which they occur. We 
consider all the scores in the interval 10-19, for example, to be 
represented by a value of 14.5; all from 20 to 29 by 24.5; etc. 
Hence, instead of adding these values one by one (after squaring 
them), we resort to multiplication which is merely an abbreviated 
form of addition. Our formula then becomes the following, or 
any of its algebraic equivalents as indicated above; 



Nor do we bother to take these deviation values in score terms, 
since that would involve unnecessarily largo numbers; we take the 
deviations, instead, in intervals, starting from the lowest interval, 
which we call zero. We can get back to score form by merely 
multiplying by the width of the interval. We do not lose a single 
iota of accuracy by this short-cut method. If we take our devia- 
tion in intervals, our whole formula then becomes 



(General formula for /oox 
standard deviation) 
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For many purposes, especially if one is working!; wit h a enleulat inf!; 
machine, tlie most convenh'nt alg(!l)raie. form in which t.o put. this 
formula is the following: 

This formula is really general in application. Tin' X may bi' a 
deviation from any mean as wc'll as from zero. 'Fhe / and the i 
are always implied in a formula whether expressed or not; they are 
merely “symbols of operation.” noW(iv<‘r, if one is working with 
single scores instead of frequency distributions, the / and tlui f 
are each 1. 

Correcting for Grouping.—When one groups data intt> a fre- 
quency distribution for the ((.alculation of a stiuidard dt-viat ion he 
loses something in accuracy. For h<* tr(iat.s his items as if they 



Fxg. XI*— Moan au iutt^rval of a normal dUtributam tba mitbpohit* 


were all at tho mid-point whereas they an» really seatb^red 
through tho interval. When tho deviation values are srpiared, 
those that lio beyond tho mid-point should adtl relatively morn 
to the moments than those that lio on the hither sid(u 'I'lni 
matter is further complicated by tho fact that tlm intervals 
normally make figures somewhat trapezoidal in shape. An 
examination of Pig. 11 will show that w«, tho mean of the scarm 
in the interval around which the moments center, does not 
coincide with i, the mid-point of tho class. When any kind of 
moments, whether squared or not, are taken from tho mean of tho 
distribution to i instead of to m*, the momenta are too great. 
And the same would be true of the aggregate of the momenta and 
of their mean, whether squared before adding or not. Hence 
both the standard deviation and the average deviation takien 
from grouped data with an interval range of more than one unit 



MPJASUREMENT OF VARIABILITY 


73 


are somewhat greater than the true ones. The same would be 
found to be true of all the interpoint variability measures to be 
discussed in our next section; all are somewhat too large when 
taken from grouped data. Sheppard has shown that, in a normal 
distribution, the correction to be made to the crude cr‘^ is 
when both the a- and the arc in units. Since all terms under 
the radical in the standard deviation formula when working with 
intervals as units (except, of couz'se, the N) are in i- units, we may 
write our corrected formula 


c(r 


/ / , A . r /2}x/y ll . 

VT** 12/ ^ ~ \ \ ^ / 12]^ 


~ n4 


- (Sa:0=* 


(Staniiard deviation with 
]^2 Sheppard’s correction) 


(29) 


In a technical note closing this chapter we give the proof of 
Sheppard’s correction. Although the reader who has mastered 
the calculus of our last chapter will be able to follow the develop- 
ment if ho watches his stop, it is unfortunately about the most 
difficult of the proofs we undertake to give in this book. 

Average deviation and the point measures of variability might 
also be corrected for broad categories. However, the corrections 
would be small, and, since wo seldom employ these measures of 
variability in refined statistical work, the correction is scarcely 
worthwhile. Indeed this whole topic is introduced hero not so 
much to urge making the correction as to warn against the 
calculation of variability measure® from few intervals without 
recognizing that the results may involve appreciable error. A 
little experimenting will show that the correction of 0.08333 in the 
standard deviation formtda will make very little difference if the 
number of intervals is 15 or 18 but will make considerable differ- 
ence if the ntimher is small. But note that the particular comc- 
tion, iVi applies only to standard deviation. 

TaWe Vli illustrates the computation of the standard deviation 
for the same data employed in the computation of average 
deviation in Table VI. In the illustration we take deviations 
from an assumed mean (at mid-point of interval 10-14) near the 
true mean, but all the processes would be completely similar if 
we were working from an assumed mean at the mid-point of the 
lowest interval or at any other place. 
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TabivE VII. — Ilevtstration op tub Comi'OTation op Standard Deviation 


Score 

Deviation 

% 

Frequency 

/ 

A 


20-24 

2 

3 

0 

12 

15-19 

1 

8 

■ 8 

8 

10-14 

0 

20 

0 

0 

5- 9 

-1 

12 

-12 

12 

0- 4 

-2 

10 

-20 

40 

Totiik . . . 


"53 “““ 
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<r = 


rcr 



- ( 1 . 12 ) ( 6 ) - 6.0 

0.0833) (5) - 6.4 


We have used ^ for tho standard deviation with Sh('ppard’.H 
correction and v for the standard deviation from (‘oar.se group- 
ing;. It will be observed that applying the correction lu'ro 
makes an approeiabltj ditforonco becau.se the immlxu- of intervals 
is rather small. Tho distribution disparts consid<>ral)ly from 
normality, so that the assumptions involved in Sheppard's 
correction fonnula are not strictly fulfilled. But tins (>rror from 
that cause is small. 

It is recommended that, for practice, the student eompute the tt 
from various other assumed means. 


POINT MEASURES OP VARIABILITY 

So far we have discussed two measures of variability that aro 
put in terms of moments. Another method of measuring scatter 
is in terms of tho distance botweem points in tho distribution. 
This takes many forms. Tho process involves, however, no 
particular difficulties, so that we may pass over its discussion 
very hastily. Tho technique of locating any of tho required 
points within the distribution is precisely the same as the tech- 
nique of locating a median, discussed in our preceding chapter. 
The principal interpoint measures of variability are the following; 

1. The Bangs. — ^This is the distance from the lowest score to 
the hipest. It may be stated in terms of the difference between 
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the lowest and the highest score. Or one may say, and with a 
richer meaning than the former, that the scores ranged from — to 

2. The Median Deviation. — ^This involves subtracting each 
score from the mean or from the median, arranging the deviations 
in order of size regardless of algebraic sign, and finding the mid- 
point of the series. If the median deviation is to be taken from 
the median rather than from the mean, a less laborious method is 
available. But this measure of variability has httle to recom- 
mend it, and it is seldom used. 

3. The Quariile Deviation, Called Q. — This is the most widely 
used of the point measures of variabihty. It is the distance from 
a point one-quarter through the distribution (Qi) to the point 
halfway through (Mdn. or Qj). Ordinarily it is taken as half 
the distance between the first and the third quarter points and is 
called the semMnterquartile range. This method of computation 
has the effect of taking the average of the quartile ranges both 
above and below the median. The formula is 

Q -s - 2 “ (Semi-interquartilo range) (30) 

4. The Inter-quartile Range, or the Range of the Middle 50 per 
Cent. — This is Qz — Qi. It may be stated as the difference 
between the two quarter points, but it is much more informative 
to give the scores at the limits; i.e., the middle 60 per cent ranged 
from — to — . 

6. P.E. is the same as Q except that it has become customary 
to restrict its application to the quartile range of a theoretical 
(consequently perfectly normal) distribution. The term should 
not be employed in describing the variability of empirical 
distributions. 

6. Range from the IQth to the 90fA Percentiles, Called D. — ^This is 
a highly reliable measure of variability that deserves more use 
than it has so far had. 

7. The ten decile pointe, located at the end of the distribution 
and at nine places within it so as to divide the distribution into 
ten equal parts. While this is not a measure of variability m the 
direct sense in which the others are (since no distances ^tween 
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poinis arc indicated) the location of the decile points does give an 
exec^llent account of the scatter of the distribution. Quintile.s 
serve the same gimcral purpose though not so compleUdy. 

8. Perceniiles. — Thc.se divide the distribution in<.o a hundred 
parts just as the decile points divide it into tenths. Tiiey might 
be located one by one. by the same tcichnicpu's as tho.s(‘ ('inployt'd 
in finding quarter points or decile points, but it is ordinarily 
sufiicicut to get them by interpolation from a smaller numls'r of 
locations, ('ither arithmetically or graphicially. Oiu'. nu'thod is to 
locate the decile points in score values, (lach detenuitusl in a 



I’lo. 12. — Cuiimlativo iM'ruoutiU* rurva. 


manner analogous to that illustrated for the median, then inter- 
polate roughly for the intormodiato piuxicntihi poinls on Um 
assumption of rectangular distributions within each of t.he nine 
interdecilo ranges. Another method, and a bi*tt<sr one, is to 
locate tho percontilo value of the top of each of tho Huetusssivo 
intervals by ascertaining how many hundredths of the whohs 
distance through tho distribution are covered by tho frequency 
to tho top of the interval in question, then to interpolate within 
each interval to allot roughly the intervening ptweentile values to 
the scores within the interval. For graphical determination tho 
best way is to locate, on squared paper or on specially mled paper 
(like the Otis Universal Percentile Graph), the score values at 
the tops of the suooesdve intervale on the y ^xis and draw 
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through these points by hand a smooth curve. To determine the 
score value of any desired percentile, Pa, find or erect an ordinate 
Pa/ 100 of the distance along the x axis from the location of the 
beginning of the frequencies to that where they end, and read the 
required value from the point along the y axis at which this 
ordinate cuts the curve. This is illustrated by the graph on page 
76, utilizing the data of Table II, page 45. 

As nearly as we can estimate from our setup, the 25th per- 
centile has a score value of about 139; the 60th, about 141; and 
the 75th, about 159. Wc could make a much more accurate 
estimate if the chart were large and there were accurately ruled 
guide lines. ^ 

SIZE OF SCORES AND VARIABILITY MEASURES 

Effect of Multiplying or Dividing All Scores of a Distribution by 
a Constant. — If all scores of a distribution take the form aXj 
where a is a (ionstant and x a variable, the standard deviation of 
the distribution becomes 



Thus, if all scores in a distribution arc multiplied by a constant a, 
the standard deviation of the distribution also becomes a times 
ixH great*. Obviously the same proof would hold if a were a frac- 
tion c/6. Therefore = {c/h)crce. This same law coUld easily 

b 

1x5 shown to hold for average deviation and for all the point 
measures of variability. 

Effect upon tf of Adding a Constant to All Scores in a Distribu- 
tion. — It will next be shown that any constant may be added to 
all tho scores of a distribution, or subtracted from the scores, 
without affecting the standard deviation. 

‘ A. S. Otb has devised a new percentile chart on which the frequencies in 
a normal distribution can be plotted on a straight line instead of the inverted 
S of the usual peroeutiie curve. This is aooomplished'by spacing the abscissa 
lines in inverse proportion to the frequencies in a normal distribution. The 
chart is published by the World Book Company. 
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The reader can easily verify the fact. I.ha(., if we had used 
(*' — a) instead of (x' + a), we would hav(> enn'i’Ki'd ^^■ilh the 
same resiilt. It is thus i)roved that adding a eonslant to c'iieh 
S(!ore in a distribution, or subtracting a constant, from each score, 
do{'s not affect the standard d('viaf.ion; it only moves the whole 
distribution up or down. The sam(^ law <’an easily bi; shown 
to hold for all the other nutasures of variability. 


MAKING VARIABILITY MEASURES COMPARABLE 
IFOR DIFFERENT DISTRIBUTIONS 

It follow.^ from our drimonstration that o-,,,, = ncr, that the 
standard deviation of a distribution, as w('ll as all the oilier 
measures of variability, is greatly affected by the order of sis!(' of 
its .scores. A standard deviation of, say, 8 in omi distribution 
does not necessarily mean greater ndativi' scatter than a v of 0.02 
in anotbt'r distribution, for the scores in tlie former may all l)« of 
an order 400 times as largo as in the latter. In order to*inak« 
variability measures comparable, Pearson has proposed a 
measure, called coefficient of variation, that, puts variability in 
terms of the mean of the distribution, since the mean responds 
directly to the general order of size of the scores. 'I’lie fortnulais 


P ax 


lOOff 

“JiT 


(Coufllcicnt of variation) (3u) 


In spite of the fact that this |tieasure has received eonsidcralilo 
attention from statistical workera, the authors have doubts of its 
value. For the mean may be distorted by a padding of all the 



MEASUREMENT OF VARIABILITY 


79 


Consider the series of scores: 0, 3, 8, 12, 15, 20, 25, 29; 
and the series 20, 23, 28, 32, 35, 40, 45, 49. The mean of the 
first array is 14 and that of the second array is 34. The cocfRcient 
of variation of the first is 68 while that of the latter is only 28. 
Nevertheless the variabilities of the two distributions are pre- 
cisely the same, the distortion in coefficients of variation being 
due solely to the padding of the scores in one of the arrays. As a 
matter of fact, if the zero point in any distribution is located 
where the scores begin to diverge, as it should properly be, and if 
the distribution is normal, the mean will always tend to have a 
value of about 3 sigmas, so that all coefficients of variation would 
tend to be around 33. Thus they would lose all value for com- 
parative purposes. They differ from 33, and hence seem to have 
a value, chiefly because of some abnormality in the placement of 
the zero point and only to small degree because of flatness in 
the distribution. Thus the coefficient of variation tells us much 
more about the extent to which the scores are padded by a dis- 
location of the zero point than it docs about comparable vari- 
abilities. A much more promising standard measure of the shape 
of a distribution, comparable for all distributions, would be the 
measure of kurtosis called for which the formula is 





(jSj, a measure of the kurtosis, i.e.^ 
the flatness, of a distribution) 


(34) 


But this measure has the disadvantage that it involves computing 
fourth powers of our scores, whereas for standard deviations we 
need only second powers. 


MEASURES OF SYMMETRY IN DISTRIBUTIONS 

If a distribution is symmetrical, its mode, median, and mean 
will all lie at the same point. If it is skew positively (i.e., has a 
larger tail stretching out toward the high scores than toward the 
low ones), its mean will be larger than its median and its mode will 
tend to lie below these two. If it is negatively skew, the reverse 
will be the case. Several measures of skewness have been 
proposed, but perhaps the following one is best: 

mean — mode ^ M — [M — 3(M Mdn.)] ^ 

- Mdn.) 


Skewnei^ 
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The value substituted for mode iu the formula is that shown for 
it on page 54. 

Another measure of skewness, in terms of higlun- moments, is 

o _ (?*'*)* (fj,, a inciisitro of skewiicss in 

Pt teriiis of higher moments) (<16) 

Tor symmetrical dist.rihu(.ions, in(4tiding normal disi.rihul.ions, 
jSi is zero. For a normal distribution jSa, mtuitionod above, is 8. 
Wo shall later give proof of this. 


COMPARABLE SCORES 


Scores from diffi'reni typcis of dat.a iU'(\ lik<4y t,o differ from ontt 
anot.htir very widely in general order of size, and variability. 
Before they can be conveniently comptired with out! attotht'r juid 
certainly before iluty ean Ixt l(‘gitimat.ely averaged, it is desirable 
to put all of them in terms of simihir units. Ontt way of doing 
this is t.0 take all of tlu'.m ivs deviations from t,h(' metuis of their 
respeetivo distrilnitions divid(!d by the st.andard dnviiilion of t.he 
distribution. Thus, if X is a score and Mj, the mean of the 
distribution to which X belongs, our dovitition is X — Mr, and our 
standard score is 




z 


(“SUnclanl score" also 
called a j 


All 2 .scores are comparable since they all tetid t.o rangt? from 
about —3 to +3, have a mean at. zero, and a staixianl d<fviat.ion 
of 1. That the mean is zero follows from the fact that, in any 
distribut.ion, the deviations above, the mean and thos«i below the 
mean sum to zero. That the standard deviation of a full set, of 
2 scores is 1 may easily be shown as follows: 


ffg. “ 





Wo shall later find that z scores have the further advantage that 
the mean of the products of paired ones gives directly the coeffi- 
cient of correlation between the two arrays. 


GOMSmiNO SIGMAS FROM DXFFBREITT SAMPLES 
Sometimes it is necessary to combine the standard deviations 
from a number of different samples, end the worker either does 
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not have available the original scores or wishes to avoid the labor 
of an additional computation from the consolidated samples. It 
will not do simply to average the <r’s. But, if the means of the 
samples are known as well as the o-’s, the standard deviation for 
the consolidated set of samples can be correctly detei’mined as 
follows: 

If x' denotes the deviation of a score from a sample mean and 
X its deviation from the weighted mean of all the samples, 

Sxf = Niffl; Zxl = Niff- + Niml 
Sajj’ = = iVaffI + NiVit 


SSa:® = -{■ Nicrf "h "h • • • "t* Nt<f» d” Nitnl 

+ Niinl + • • • + N,ml 
[N iffl + Nzff'i + iV’ao’s + • • • + N,(tI + Nitnl 
_ / + Niinl 4 - • • • + N.mj 

~ V Ni + NiTN,+ ■ ■ • + N, 

(Formula for combining <r’s from different samples) (38) 

where m,- is the difference between the jth sample mean (j being 
any sample) and the weighted mean of all the means. 

RELATIONS BETWEEN THE VARIABILITY MEASURES 
When we come to the chapter on the normal curve, we shall 
find reasons for the following relations among measures of vari- 
ability. They hold strictly only for perfectly normal distribu- 
tions but will be found to represent the relations pretty closely in 
most of the distributions met in practice. 

Q = 0.6745(r c = 1.2532 A.D. 

A.D. = 0.7970ff V = 1.4825Q 

D * 2.56310- A.D. « L1830Q 

In the chapter on Reliability (page 151) we shall find that the 

standard deviation is the most “reliable” of the variability 
measures; its standard error is least of all in terms of its own 
magnitude. After this comes A.D., then D, then Q. This, and 
certain other mathematical properties, are given as reasons why 
the standard deviation is to be preferred to all other measures of 
variability in refined statistical work. 
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But, in spite of those advantages in theoretical statistics, the 
standard deviation is not a very apt statistic to use in describing 
variability for lay readers; it is “Greek” to them. Asid(i from 
the range, the variability mea.snro likely to carry the most con- 
crete meaning to laymen is the range of the middle 50 i>or ccart. 
Of the moment values, it is the average deviation rather than the 
standard deviation which will seem most se.nsible and nreaningful 
to such readers. As far as reliability is comiorned, the superiority 
of the standard deviation over the average deviation is s(j slight 
as to leave the average deviation a useful statistic to employ in 
describing an ompiric^al distribution, especially when addrcissing 
a lay audience. 

AN INDEX OF INSTITUTIONALIZATION 
Professor Floyd H. Allport and his associates have. studi<'tl 
the confomrist behavior of individuals under the pressim* of t lu) 
mores, or other saiKdions, and have found that a j shiip<'«l curve 
frequently describes it. When coming upon a sl.op sign, for 
example, most automobile drivers may come to a full stop. But 
some may meniy slow up to a near stop, a smaller propotiiou 
slow up less, and a small proportion may go alu'tul without, any 
slimkening of speed. If units of degrc(W of slowing art' plact'd on 
an X axis and frequencuis on a F axis, tlus tlistribntion of these 
froquencitis will be shaped like a j, or like a reversi'd j. 'I'hi! 
statistics of j sluqxid (uirves have not been very fully worked. 
Such statistics as means and standard deviations are, of ctnirse, 
formally applicable to this type of distribution iw well as h) other 
types, but they do not stiom to give a very apt dtweriptbu of the 
situation htire involved. We are suggesting a ust'ful slatistio 
for this purpose jSj, which has the oonvontiotial nataning of jS* 
except that the moments arc to be taken as deviations frcjin the 
norm rather than from the mean. Ijot us approach this through 
an example. 

Froderiksen, Frank, and Freeman^ noted the twhavior of 
motorists at a sharp turn on a multiple-lane highway, where 
safety demanded that cars should remain in their own lanes. 
They recorded the number of cars which 
0. Conformed to the standard by staying completely in line. 

Fbsdsbikbbn, N., G. FBjt.KX, and H. FBmuAN, “A Study of Conform- 
ity to a Tiaf&o Regulation,” /. Abn. and 8oe. Piychel,, Vol. 84, p. IStO (19^). 
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1. Crossed the white line less than half a car width. 

2. Crossed the white line more than half a car width but did 
not cut lanes. 

3. Cut lanes. 

The percentages in each of these eases are given below for cars 
driven by private chauffeurs, and beneath the line of frequencies 
per hundred are the calculations required for /3j. 


Units op Divbrobnce from thb Norm 


X 

0 

1 

2 

3 

Sum 

f 

85.3 

12.1 

1.7 

0.8 

100 


0 

1 

4 

9 

— 

fx^ 


12.1 

6.8 

7.2 

26.1 

fz^ 

0 

12.1 

27.2 

64.8 

104.1 


SWAT _ _ (100)(104.1) 

(SaiV-^)* (2a;*)* (26.1)* 


For taxi drivers the percentages in the four classes were 

0 12 3 

80.4 14.3 3.1 2.1 

|3i' = 11.8 

The /3'j gives a measure of conformity which increases in size 
as the extent of institutionalization or socialization increases. It 
will be noted that private chauffeurs are more susceptible to the 
pressures upon them — their behavior is more institutionalized — 
than are the taxi drivers. This index of institutionalization 
would be 1 for complete nonconformity. For a chance allocation 
of frequencies into a rectangular distribution (with the norm 
taken as the first class), it would be 2 for four classes and nearly 
2 for other numbers of classes, the formula for its exact value 
being 

6(3n» - 8n - 1) 

6(2n* - 3»+T5 

where n is the number of classes along the x axis. For a normal 
distribution (with the norm at the mode) it would be 3. As the 
extent of conformity increases so as to make a more and more 
narrow stemmed j, the index of institutionalization increases and 
approaches infinity as the conformity approaches completeness. 
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This procodurp assumes equal spaciuK of the xiniis of extent 
of eonformity along tlvo x axis. But \v(^ eaii see no alternativti to 
this. It would be possible to take, the moments for from l.he 
mean, as is the custom, but wc beli('vc taking l,hem from tho 
norm gives for this purpose a nmeh mort' meaningful and useful 
index. If the invostigafior’s purpose is not (.o nunisun' (.he degree 
of instiitutionalization but instead, or in addition, to ('xpr(>ss tho 
slope of the curve in terms of an equation, he luis availabh* the. 
possibility of fitting to his dat.a oiu? of .s(‘Vorul t.ypes of etirves, 
including the curve of decay which we discuss in Chap. XV. 

PROOF OF SHEPPARD’S CORRECTION FORMULA 

The rejuler is warned t.hat the following discnission is highly 
technical. Tin; stud(nit of rclat.iv<!ly eh'nn'utary sl,atist,ies sljould 
skip it. 

As a preliminary to the devcdopmc'pt of Sheppanl’s correedion 
formula wc shall need tt) develop Taylor’s forimda (“Taylor’s 
series’’) because it is involved in th<i Slu'ppard <lev«'lopment and 
was not included in our chapt.tn' on calculus. 

Let 8 be the sum of a power sc'ries in tt'rms of (j “• «), where 
a: is a variable and a is a (umstant. 'riien tlu^ sum series must, be 
a function of *, and, if we may asstime that the Hmies converges, 
we may write us follows: 

(.4) (S =* f(x) - bii + bi(x - a) + hix - «)* 

+ lh(x - a)» + > ■ • 

where tho coefficients ?;ii, 6i, h, ci,c., remain to be det4‘rmim'<!. 
It is our purposes now to get values for tln-se (soeffituimts. 

If wc substitute in Kq. (A) z = a, wo get l>» » /(a), for all the 
other terms be,(!ome zero and drop out. That is, the first term 
on tho right e<iuttls tho value of tlm function on the hsft when z 
is evaluated at a. Take now the first derivativt* i>f /(y) aiul g<*t 

f(x) * + 2bi(x - «) + 3b, (x - a)« + 4b, (x - a)» + ■ • • 

Substituting again x - a, we got bi » f(a). That is, the 
coefficient of tho second term is tho first derivative of the function 
f(z) when timt derivative is evaluated at ai ■■ o. Take now a 
second derivative 

f"(x) » 1 • 2b» + 1 • 2 • 3b, (x -a) + 3- ibiix ~ o)» + • • ■ 
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Letting a: = a, we get from the above 


l-2b.=r(a);b,=^ 


The third derivative is 

f'\x) = 1 • 2 • 363 + 1 • 2 • 3 • 464 ( 3 ; - a) + • • • 
When this is evaluated at a: = a it gives 


1 - 2-363 =f"(a);h = 


ria) 

1 •2-3 


If we continue this process, we shall obviously get the following, 
when /"(a) stands for the nth derivative of the function/(a:) when 
the derivative is evaluated at a; = a, and |n stands for factorial 
n, i.e., the product of all the integers from 1 to n inclusive: 

(B) B = /(a)+^^(a;-a)+^(x-a)“ 

+ (x - a)* +••• + ••• + (x - a)" + • • • . 


That is, if /(x) is developable into a power series in (x — 0 ), the 
coefficients of the successive powers of (x — o) must necessarily 
be the successive derivatives of /(x) when these derivatives are 
evaluated at x = a, divided by the factorial of the power of 
(x — a) in the respective terms. 

That is Taylor’s series. Wo can now put it in a form more 
useful for our immediate purpose by replacing a by x,- and then 
letting X <== a + h = Xi + h, whore (x, + h) varies over a subset 
of X values within which subset Xi is constant and is a variable 
increment. Making in (B) these substitutions, 


(C) iS=/(xi + fe) 


fixi) + ^ h + A’ 


li 




+ 




This second form of Taylor’s series enables us, when more 
convenient, to shift from the development of a power series 
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in terms of one variable to its development in terms of another 
variable. 

We are now ready to take up the development of Sheppard’s 
formula for the correction of a standard deviation for broad 
categories. In the disc!U.s.sion we shall need to anticipate some 
facts and symbolism about t,hc normal curve \vhi(di we treat in 
full in a later chapter. 

The standard dc'viation is t he scpiare root of t he stun of t,he 
squares of the individual scores (in deviation form) divided by 
the number of cases. Biit an ink^gral is a sum, and in this 
development we shsill fnioly replace tho convcmtional summation 
sign by the symbol of integration. Rem(uuber that the scores 
are laid off as to size on tho x axis and that the ludght of the 
curve, denoted by y, expresses tho fre(iuen<‘ie.s. Basically a 
standard deviation is determined from scores, hut in pratdico 
it is often convenient to group scores into intt'rvuls and to treat 
thcvse intervals as scores themsedves. As point<'d out on pagi' 72, 
this grouping makes a diffenntce, and it is tlu^ purpose of the 
present development to derive a fornuda for infi'rring th<^ eorreet 
standard deviation, which would bo obtained by working from 
individual scores, from tho one obtaiinul by workiitg from 
intervals as units. 

The height of any ordinate of tho normal curve is dt^pendent 
upon its place along the x axis; i.e.., the y is a function of x and 
may bo writkui jis fix). Simte the stmulard deviation must 
sum tho Hquarts) of all scores in tho distribution from -- oo to 
+ 00 , wo may write it, 

(D) N<tI « x^fix)<k 

But when wo work with grouix^d data, we do mjt consider tho 
a: placomcnt of every individual score but take all within an 
interval as having the value of tlie mid-point of the interval. 
Lot us call such mid-point X{. Tho frequency corroMp<mding 
to any Xi value will then, of course, \m\ tho population within 
the particular interval. If, for the sake of distinction from tho 
corrected <r, we place a bar under tho <r to indicate that it ia the 
standard deviation computed from mid-points of intervals our 
formula wffl stand as follows: 
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where h is the length of the interval. 

Let us now make the substitution a: = a;, + w. Then since 
Xi is a constant for any interval, dx = du. Our limits of integra- 
tion will now be —\h and -hi A, and we may write 

(F) ^ A ri'fixi -h u)du 

~ 00 

We shall now utilize Taylor’s formula, (C) developed above, 
to expand f{Xi -f u) in powers of u, replacing f(xi -f «) in (F) by 
this value. Then 


+£|i.*+ 


Indicating the integration term by term and taking the sununa- 
tion with each term, (G) may be written 


is r 


+ iA f>> 


fix,) 


uHu -h 




4-JA 4ftt 


rixi) 


uHu -h 


Intcgrating as indicated in (ff), we get 

« wd = 2 MI + 2 ; 




rr'N«*i+»* 


We must now evaluate exprei^ion (I) between the limits speci- 
fied; i,e., we must substitute in each term —jfh and -hift and 
take the difference between the values at these two limits. 
When we do so, each term containing an even power of v will 
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drop out, sinco the upper and the lower limits will yield the samo 
mimerical value and will have the same sign. We are l.lniH left 
with the following: 


00 


"f ” 


(j) + h^'^ 


x; 


/"fe) 


4 - 00 



»- 00 


4 - 


The values of the summai.ion terms may Ixi fouiul hy the 
TOuler-Maolaurin sum formida. This formula puts th(! expression 
of a sum in i.erms of an integral and certain furllu'r U‘rms which 
thems(jlv(is involve dwivalrives. Sineci in our spt'cial cas(' we are 
dealing with thc! normal curves funct.ion and since^ all the h’rrns of 
the Euler-Maclaurin sum formula for tliis ease, except. t.h<! first, 
involve derivatives of tlwi normal funct,ion which are to ho 
evaluated at the limits — <» and + ®® , wht're they equal sicro, 
all the terms except the first in liaeli summation drop out, 'fho 
Euler-Maclaurin formula also involves l//t as a coefficient of 
each integral when the sura is eipialxid to it. Heneo, applying 
the Euler-Maclaurin formula to (J), wo are left with 


(K) Nsd 




x^f{,x)dx + A® J" 
+ h* 


^ if'ix) , 

*■" r'ir) 


i: 


X 


dr 4- 
2’i5 ® ^ 


Lot us now consider in Huccession t.he terms on tlie right. 
Remember that /(x) is y, the frequency; and notice that x has 
replaced x<. From (D) we have that thc first tm’in is iV<rJ. 

The second term requires multiplying x“ by the. second deriva- 
tive of the normal curve, integrating, and multiplying by 
which equals h’‘/2i. On page 27 wo showed that the secoim 

deriivative of the nonnal curve function is — jj— f(x). Sub- 
stituting this value for f'(x) in the second term and Nvi for the 
first term and neglecting the remaining terms, which when 
evaluated , are found to have values so small that they may be 
considered trivial compared with the value of the first two, we 
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may write 


Ns!, = 

Separating the second term into two integrals, 

In the normal curve chapter we learn that the quantity 


/- 


x*f{x) 
Na* ’ 


which is called /3j, equals 3 for a normal distribution. The 
second-term integral has, therefore, the value 3JV. As we have 
seen before, the value of the integral in the numerator of the 
third term is N<r^. Making these substitutions, we have 


Nsl = N<rl + 


ZNh’^ 

24 


Nh^ 

24 


Canceling the N appearing in each term and combining the last 
two terms, we are left with 


2 2^ A* 

fitj “ ffj + 

Transposing and indicating the square root, we get the formula 

= -yjzi ~ j2 

The reader must be cautioned that the crj under the radical 
has been developed in terms of score values. In practice it 
will, in a frequency distribution, have been calculated in terms 
of intervals. By applying formula (31), wo can put this in terms 
of intervals. Calling cr^ the variance calculated in intervals as 
uidts, 

I p I it (Standard deviation. 

<r» « */AV* — ™ =» a Jff* - TO with Sheppard's (39) 

y 12 \ 12 oorreotion) 
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Exercises 

1. Using the distrilnitions sot up in the oxtTcisoH from Table IV in (”'hap, 
II, compute varialnlity measures to as gr<»at ('xUmt as may be needed to 
bring you to the nee<*Hsary masteri(‘s. 

а. Standard deviations. 

б. Average dt'viatious. 
c. IVreentih's. 

(L Decihi point, s, 

(Juartile points. 

/. Inter(le(nh‘ ranges. 
g. Int(‘r<iuartiU‘ ranges. 

/i. Senu-inter<iuartil<‘ range's. 

2* Compute out' or mon‘ stamhml deviations from distributions groupi'd 
into broad eatc'goru's (thre^e to six intervals) ami apply Slu^ppard^s eorreetion. 
If you have e.mploye<l tlu' same' data from 'rnbi<' IV from whieh you eonv- 
pxited <r^s in lOxereise 1, eompar<' the <»btained from broml grotipings with 
that obtained from individual seor(‘s or froiii grotipings in narrow rangen. 

3. Compute measures of skewm'Hs for tlie (list ribut ions with whieh yoti 
have w'orkcHl, 

4. Turn a sampler of seores from one of tlu* distributhnm into standard 
m^ores.*^ How nearly dot's the nu'un of tin? statulani seort's tins sample 
come to zerot Why tlu' <im(*repatie.y? 

5< For a sjunple of about 40 seores from one of the tiisiributUms eonipute 

6. For this same sanipUs eompute (iu 

References for Further Study 

DxoKiDt, J. W.: **On. the Ileliability of a Btamlard Beore/* */. Edue. Ptiy(tholt 
Voh 2U pp. 647-549. 

HottST, Paul: **Obtainiug Comparable Beores frotn DisiributioiiH of Uiffer^ 
ent Shapes/^ /. Amer> EtatMcMl Amoc^^ Vol. 2d, pp. 4r4i 4d<h 
SuKPPAttu, W. F.: **The Ckdeulation of the Momerils of a Fretiueney Dis- 
tribution/^ EiomHrika^ Vol. 5, pp. 452--4r>3. (On llu' samt^ topie see 
also Pearson in Biometrikat Vol. 3, pp. ^OH-^SOP.) 

Eeitz, H. L.: Handbook of M athomaticul i^iatwticn^ 1924, p, BO, (An 
additional correction in A.D. for the interval containing the mean.) 



CHAPTER IV 

THE BASIC FORMULAS OF RECTILINEAR CORRELATION 

Correlation relates to the extent to which two series vary con- 
comitantly. We can compute a coefficient of correlation when, 
and only when, scores in two related series are 'paired. Thus we 
can determine the coefficient of correlation between history scores 
and geography scores if each of a set of students has a score in 
history and a score in geography. We can correlate the scores of 
a set of boys with those of a set of girls if both sexes have taken 
the same test and our concern is to see how closely the two sexes 
parallel each other in the proportion knowing the several items 
of the test, for here each item has a pair of scores. But, apart 
from the binding of the two series, by paired scores, it is not 
possible to apply con-elation methods in the technical sense. 

It is important that a student should understand the nature of 
correlation, not merely work with its formulas as magic. The 
principle back of correlation is really very simple. Suppose a 
student makes the score of 9 points above the mean score for his 
group on a history test and also 9 points above the mean on a 
geography test. We shall lay this off on Fig. 13 by going 9 
units to the right from the intersection of the two central axes for 
the geography score and then 9 units upward to represent the 
history score. Point A, therefore, represents the location of this 
student with respect to both his scores. Suppose student B 
makes 12 above the mean in history and also 12 above the mean in 
geography; C makes 14 below the mean in history and 14 below 
in geography; I> makes 8 below in each; and E makes 16 above in 
each. It is easy to draw a straight line through all of these 
points; and this line will pass through the intersection of the XX 
and the YY axes, which point is technically termed the origin. 
At point A on this line the perpendicular distances to the XX 
axis and to the YY axis are equal. That is, AS «= 80, whence 
AS/SO “I. A corresponding thing is true if we take other 
points on the line: B, C, D, E, or any other. The value repre- 



92 


STATISTICAl. PROCI'JDII lllOS 


ficnted by ihc ratio between these two legs of t.he right triangU'., 
also, is called the slope of the line which consi.it.ntcw the hypot- 
enuse, for which value wo shall employ the letlt'r b. In our 
problem, b is evidently 1. Each y value is, therefore, equal to 
1 times the corresponding x value, and the relation is oim of 
perfect agreement. 


y 



y 

13 . — Pwfoot oorrolation. 


But lot UR next post, in Eig. 14, dot« reproHontJng the Hoorea 
in Table VIII, page 93. These dots have a tendency to fall 
along a straight lino, but wo would have a difficult time to draw a 
single lino through all of thorn and certainly no straight lino could 
bo made to pa.ss through them all. But wo can draw a straight 
line that passes through the group of thorn and that represents 
the general trend of the group of points as nearly as possible. 
This lino will have aslope which will indicate the general tendency 
of the scores in the one series to be greater or loss when those of 
the other are greater or loss. 'We shall call the slope of this line 
b, m before. 
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But how find the value of this 6? The answer to that question 
constitutes the essence of a correlation formula. One can make 


Table VIII. — Illustration of Computation of Correlation by 
Individual Pairs 

Data, scores on the Abbott-Trabue Test of Appreciation of Poetry by the 
same pupils at interval of 5 months, slightly doctored 



an empiricai estimate of h by stretching a string and adjusting it 
until it seems most nearly to fit the measures. The student is 
advised to try that method with the problem of Fig. 14. Start- 
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ing from any point whatever on his thread, he .should eouiif, the 
number of units on the squared paper down (or up) to tlui XX 
axis, then the number along this axis hatde to the origin (wlK'n; 
the axes intersect). The former divided by (.he iatlts- is tiu' slop(i 
of the line and approximately the coefficient of eorrt‘lalion. 
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Fi«. 14.' -Ptmitive but iniporftirt t‘<>rr(4ati<»n. 


The Pearson produet-momont correlation formula is merely a 
more precise device for finding the slope of this lino. It is I>a*ted 
on a principle, generally accepted by mathematicians, that a linn 
best fits its data when the sum of the squares of the. misses (errors) 
is a minimum. The development of a formula for the slope of a 
line that fulfills this condition is very simple, but it involves a 
little calculus. 

Let b be the slope of the line required (the straight lino that 
best fits the trend of the paired measures) f let a; be a given score 
in the first serias (in deviation form); let y be a oorresponding 
score in the second series; and let y be the value this y score 
would need to have if it were to lie exactly on the regression line. 
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Then, by definition of 6, 

y = hx 

The “error” by which y misses y is (y — y). The condition of 
best fit is that the sum of the squares of such errors for all the 
pairs of scores in the problem shall be a minimum* Hence 
2(y — §y is to be a minimum. Substituting for y its equivalent 
hx, squaring, then placing the summation sign with each memberj 
which is a legitimate way of summing such a quantity, we have 

"( 2 / ~ Vy = 2 ( 2 / — hx)- = ('Ey^ — 2hExy + b^Ex^) 

is to be a minimum. Since we arc to find a value for b that will 
make this quantity a minimum, wc must differentiate the expres- 
sion with respect to h and set the derivative equal to zero (see 
page 10 of this volume). Since the first term contains no h, it 
will disappear from the derivative. In each of the other two 
terms the elements other than h will be unaffected by the dif- 
ferentiation, but the h will have its exponent decreased by 1, and 
the coefiicient of the term will be multiplied by what had been 
the exponent of the b. Thus differentiating, we got 

-2Exy -f- 2bEx^ = 0 

Transposing, then dividing by the coefiicient of 6, 

(Formula for the slope of a 
Eixv straight line fitting the 
2bEx^ = 2E3iy; b„x — -rrr trend of paired measures (40) 
Ex so as to minimize the y 
residuals) 

That is the formula for the slope of a line fitting paired meas- 
ures so as to minimize the y residuals; it is called the regression 
formula for y on x. Frequently it is used in just that form, 
especially in business statistics. But we may put it in more 
familiar shape if we divide both sides of the equation 26 Sx* 
= 2Exy by 2JV, N being the number of pairs of scores in the 
problem. 

, Ex^ _ Exy 
o-ff - -JT 


Now we have seen Ex^/N before; it is ai. Making this substitu- 
tion, 


btrl 




IT 
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But still our formula for tiro slope of the lino lacks a standard 
meaning, bcc.ause a- and y may be measured in diffortmt units, and 
the slope is gr(«itiy affected by the relative variabilities of th(i 
measures etnployed. We shall remedy this by choosing a new 
symbol, /, for the slope of t he line when our measiires have been 
t.aken as ic/cx and y/<r,„ thus making the measures of equal 
variability. In this notavtiion 

J? = r — ; tiiercifore. f/ — tjc 

ffy ffs CTx 

But in our former not.ation, § = bx. TluTc'foro 


rx = bx, r = h and b = r 

ffa <fy (ft 


Substituting the value of r thus derivisd,* 


r 



-■r?/ . ff* 

~Nal tty 


^xy (Pearson pnxluct-ineiini'iit 
■a/"' - formula for eoetlicieiit of (41) 

lyctxfty iiorrelatioii) 


If we c,lu)ose to do so, wti may put this basic, correlation formula in 
a litt.le diffc'fent shape* by substituting for its value y/^x'^/N 
and for <r„ its value lly'V// and have 


2/y 

NV'i^zyN ■ i^yyN) 

™ . (Ht'coml form for the ha«i(! P<>iirHon jtroil- t* « 

• iSy* tu‘t-moineiit correlaliiui formula} ' ' 


This is the principal formula for r, the Pearson prodtmt-mom- 
ent formula, whenever the measuroH are taken in the form of 
deviatiojiH from the means. It is, you see, merely the formula 
for the slope of the straight line best fitting tl>e meastires whtm 
the correlation chart has been laid off square- -when the varia- 
bilitios in the two directions have boon oqtializt*d. This lino is 
called the regression line. Tho student who knows a little trig- 
onometry will soe that r is tho tangent of tho angle that the 
regression lino makes with the X axis under the special condition 

I The standard deviations of the samples must be used in this and in lubaa- 
quent formulas for correlation, not tho population s. If population values 
are used in the denominator, they must also be used in the numerator, and 
the two oorreotions precisely oanoel each other, 
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that the variabilities of the two sets of measures shall have been 
equalized. When we gather our data into columns, as is done in 
Table IX, the regression line becomes the straight line most 
nearly fitting the means of the columns as well as the straight line 
most nearly fitting the separate measures. For this reason it is 
sometimes called the line of the means. An r may be calculated 
either from the individual paired scores or from a correlation 
chart in which the scores have been grouped into intervals. The 
formula has precisely the same fundamental meaning and essen- 
tially the same form when using either arrangement. As the 
student goes on through statistics, he will have many occasions 
to marvel at the unexpected ways in which this correlation 
formula crops up and at the transformations through which it 
can be put. It is one of the most fascinating formulas of mathe- 
matical science. 

An inspection of the formula will show that the new element 
involved in correlation is Sxy; the sigmas we have treated in an 
earlier chapter. Sxy involves multiplying each x by its paired 
y value and then summing these products algebraically (the 
multiplying being done, of course, pair by pair before the adding). 
The multiplying may be done pair by pair, or the xy products of a 
like value may be grouped into frequencies and each zy value 
multiplied by its frequency before addition. It is this latter 
thing that one is doing when he computes an r from a correlation 
chart. Sample solutions are shown on pages 93 and 100. 

The formula for r that we developed above, 

j.- 

Ncx^v 

was based upon measures that are taken as deviations from the 
exact means of the series to which they belong. But it is seldom 
desirable to take deviations from the true mean in working a 
problem in correlation, since customarily we got decimals which 
are cumbersome to handle. We do better to work from some 
convenient assumed mean even though we may know the true 
mean, just as was the case also in computing standard deviations. 
The development of a correction fonnula that will allow us to 
use an assumed mean and yet get the correct r is very simple. 

Let X be the deviation of a score from the true mean in the X 
series and y a corresponding deviation in the Y series. Let x' 
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and y' bo, correspondingly, deviations from tlu' assmnod m<^ans. 
Let Cx be the amount by which l iio assunu'il mean in th<‘ X series 
differs from the true X m«'an and he a i'orn'spouding value in 
the 1’ series. Then for any one pair, 

x' == X + Cx, and y' ~ y + 

The product of any one pair will bo 

x'y' = (.r 4- 6-x)(y + Cy) - xy + xcy + ycx + CxCy 

Summing for all the pairs, 

^■jr'y' ^xy + CyHx + + ^CxCy 

But, siii<‘<! X and y are llu; <levialions from Ihe true means, 
their r(‘.speetive sums equal zero. llene<‘ (h<‘ two mhldh' terms 
beeonte zero and drop outi. Also l^CxCy Ixteonu's NcxCy, heeatsso 
this term is taken once for each pair. 'I'liendoW! 

ilx'y' “ -xy + Nt^fCy 

Ti-ansposing, 

ilxy » 2x'y' — NcxTy 

Substituting this value in the original rearson formula above, 

Nffa^y 

i'Sx'y'/N) — CtCy (Ouo form of the iirothiet-momont 

sa formula when meiiHtiren art) ( 42 ) 

Uiktm from aMHumed iiifuim) 

In dealing with the c’s in tho above formula, it must bo reunem- 
berod that tho algebraic sign ia to be eonsidereti. Hoinotimos 
the product of tho two c’s must bo added arithmotieally to the 
rest of tho formula instead of subtracted — if one happens to be 
positive and the other negative. 

We can, perhaps, simplify this formula further for ease of 
oomputation by noting that e., the amount our assumed mean 
in the X series missed the true mean, is always equal to Zx'/N and 
similarly c# is equal to Xy'/N. This is true no matter where the 
assumed mean is taken, as we have already learned in our chapter 
on central tendencies. It is true even when the assumed mean is 
taken at zero, in wMoh case all the deviations will be precisely 



BASIC FORMULAS OF RECTILINEAR CORRELATION 99 


the same as the corresponding scores and the c’s will be exactly 
the means of the respective series. We shall, therefore, have 
perfectly general formulas if we substitute these values for the 
c’s. We may also substitute for our or’s equivalent values we 
learned in our chapter on variabilities. Then 


hx'y' — iVciCj, 




:s xy - JV(sx7iV) ■ W/n) 

iVV(Sx'VW) - (Sx7W)2 - (Sy'/W)® 

Sx' • 2j/' 


'Zx'y' - 


N 


Nlix'y' - 2x’2y’ 

VWT^x'^ - - (Sj/0‘'] 

(Recommended general formula for prod- 
uct-moment correlation when measures 
are taken from an assumed mean) 


(43) 


The x’s and the y’s may be taken from any mean the worker 
pleases, and the re.sultiilg r will be not only approximately 
but absolutely the same; or the scores may be taken exactly 
as they stand, which amounts to taking them as deviations 
from zero as an assumed mean. To take them thus as original 
scores saves all subtractions and all necessity for watching 
algebraic signs (unless the original scores themselves involve 
differently signed numbers). But the numbers will be larger 
than if we work from a moan near the true mean. When working 
with a Monroe calculating machine, we always use this last 
formula, taking the z'’s and the j/"s in terms of the original 
scores, because the formula taken in this manner fits the calculat- 
ing machine ideally and large numbers are no handicap in working 
with "a machine. But the worker who is operating with a pencil 
may prefer smaller numbers, even if he must bother with plus 
and minus signs, and hence will wish to work from an assumed 
mean as close as feasible to the true one. But the formula is 
precisely the same in either case. We recommend the last 
formula pven above ^d the basic formula (for measures taken 
as deviations from the* true means) as the only product-moment 
oormlalion formulas worth the student’s effort to remember. 
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"rABtiK IX*- 8<^<)nKS ON Ol)D-NrrM»Km0I) and I'lvWN-NltMtiKUKn ItKMS (Hi' A 
I'KST in Kl)U(*ATl<>NAti PsYCIlOlAXi Y BY 10 () ( SrUDHNTM 
AiTanj3;o(l in a correlation tahh^ 



^105 ; 2975 593 ; 473^__ _ ^ ^ 

“ ^(ioo"- 3«5? - C6^»J(i(i8 "^ ^036 473») 

The product-moment formiila for corrolation holds exactly 
only for scores taken pair by pair; when an r i» computed from a 
correlation chart, it loses somewhat in precision. However, 
if the number of cases is 40 or more and the number of catenoriwi 
for each of the arrays is reasonably large, the loss is sufficiently 
small to bo negligible. But one should never compute an r from 
a correlation chart whore tho number of cas^ is leas than 30 
or 40 unless tho range of scores in an interval is only one or two. 
Tho number of categories should be about 12 or more. If an 
r must be computed from a small number of categories, Shep- 
pard’s correction should be made in the standard deviations that 
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constitute the denominator of the fraction (see page 89). We 
shall in a later chapter more fully discuss the problem of cor- 
recting r for a small number of categories. 


THE SUMS AND THE DIFFERENCES FORMULAS FOR r 


Sometimes it is very convenient to employ a formula for r 
that involves adding or subtracting the paired scores instead 
of multiplying them. We shall develop formulas for that 
purpose. 

Let d be the difference between any two paired scores when the 
scores are expressed in terms of deviations from the means of 
their respective series. Then 

j _ S(x — yy _ S(a:* — 2xy + y^) __ Sx* llixy ^ 2?/® 

N ~ N ~ N N N 


Multiplying both numerator and denominator of the middle 
term by (t* cry and putting each of the other terms in the form of 
equivalent o-'s, 


crj == <r| + <r 


2 

» 


2'2xy 

Nffxirg 


CxCTy 


But the final term now contains the formula for r. Substituting 
r for its equivalent, then transposing and solving for r, we have 

ffd = O'® -i- (T® — 2rffxffy; 2r(r*ff„ = o-J — vj 

«r| -|- ff? — <r3 (Formula for r in terms of the difference 

j. ss between scores when in deviation (44) 

■w»(r» terms) 


We arrived at this result by taking all our measures as devia- 
tions from the means of their respective series. But we can 
easily show that the same formula holds if we work with the 
difference between raw scores instead of the difference between 
deviation scores. <r| and oj will be the same, of course, regardless 
of whether we computed them in terms of deviations or in terms of 
raw scores, provided we made the proper correction on account 
of taking zero as the assumed mean. We need only show that, 
if d is the difference between paired scores when these scores are 
in deviation form and D is the difference between corresponding 
raw scores, then era equals xp. 

d^ix-v)’=‘[iX- M,) - (F - My)\ 

^ X - Y - (M„- M„) = D - {M,- My) 
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ffrf will necessarily bo the same as vn because in the latter case 
etieh item will merely have a constant (Ai» — My) subf.racited 
from it to make it ideiit.ieal in value with its correspondinK d, 
and the subtraction of the same value from each te:rm of a series 
docs not affect the standard deviation of that, seri<'s (s(K' pa^c 
77). We may, therefore, write our formula for r lus follows: 


r = 



(Foriiuil.'i, for r ii> tcrins of tlie <liff(>r- 
eiK*<\s hoi\v(*t‘n raw HcortNs) 


If the variabilitit^s of l,ho two arrays are e(pml, as wouhl be 
approximately true of two forms of a test, this formula simplifies 
to the following: 



(Fortmiln. for r in tpriiiH of (iilT<'r('nt‘('.s, assnin- 
2(;2 iuK ('ipiul variiiliilities in (lie two iirniys) 


m 


If, finally, the mc*ans are equal as well as I lie variabilities, 
we can simplify formula (45) a little further by wmsulering the 
<r^. 



But 

w « s(.x: - y) * (2JX - sy) » (nm, - NMy) 

= NiM, - My) 

But, if the means are equal, the difference between itf* and My 
is zero and -7) beeomes zero. '’I’herefore {^1)/N)^ beimmes 
zt'i'o and erj ('quals SD'/AT. Substituting this valuo in formula 
(46), wo got 

V na (Formula for r in tnriHH of difTorpnew! 

„ 1 _ botween paired Hcorcs, owiuniina /4o\ 

* 2 ^ff’ wpality of varlabilitiuB and of 

means m the two arrays) 

This formula can be applied in certain practical situationB, 
particularly in the correlation between two forms of the same 
test or two halves of the same test, but always with a <»rtain 
risk that the assumption of equality of means may not hold. 
However, it is especially useful to us just now because it is the 
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basis for the development of the important Speai’man ranks 
correlation formula which we shall treat presently. 

The reader will be easily able to verify the fact that, if we had 
taken X + F = /S, we would have arrived by a similar procedure 
at a formula for r in terms of the sums of paired scores as follows: 

„ _ ~ oj ~ g’y (Fomula for r in terms of sums 

* 2tr^y of paired scores) ' 

and if the variabilities may be assumed equal, 

er| (Formula for r in terms of sums of 

T = — 1 paired scores, assuming equal (48) 

^ variabilities in the two arrays) 

Occasionally we may have standing on our records an average 
between the paired scores instead of the sum of the scores, and 
we may wish to employ these data to get a coefficient of cor- 
relation between the two arrays from which the averages were 
taken. This would be the case, for example, where a teacher 
had entered in her book a mid-tenn grade, an end-term grade, 
and a final grade that was the average of the two and wished later 
to learn what had been the correlation between the grades 
for the two halves of the term. Since all measures are half 
as great as when couched in sums instead of averages, the 
variance will be one-f ourth as large as that of the sums. er| equals, 
therefore, 4<r,^, and 

„ _ — oj — gj (Formula for r in terms of the aver- 

ages between paired scores) 

THE SPEARMAN RANKS FORMULA FOR CORRELATION 
We shall next develop a formula for computing a coefficient 
of correlation between two series when put in terms of the rank 
order of the items instead of raw scores. Thus we may know 
about a set of pupils only the order in which they rank in history 
and the order in which they rank in geography, and yet we may 
wish to compute a coefficient of correlation between standings 
in these two subjects. Or, even if we know the actual scores, 
we may prefer to translate these scores into rank orders and 
then compute the correlation coefficient from the ranks, on the 
ground that the mathematics involved is somewhat simpler. 
The formula that we shall treat for this purpose was first devel- 
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oped by Spearman, the method is called the Spearman ranks 
method, and the symbol for the coefTunent of correlation thus 
<lerived is desi>>;nat<xi by the Oroc'k Ict.U'r p (rho). 

Our st.arl.ing point in the development of Spearman’s formula 
is our formula (•1(5) above; for in the ease of two set.H of con- 
tinuous ranks with the sa.ine numb(w of individuals in each set 
it is clear that the nn'ans of t.lio two arrays would be e<puil and 
so would t he variabilities. Ilowcvcir, our sc.ortis have now beciomo 
ranks, so that D is now t.he difference bet.w<'en the ranks of an 
individual il.em in the two s(tri((s. Wo might,, with any given 
prol)lem, apply in the customary way this formula just as it 
stands. But. in the special c.as(! of ranks we c.an put it in a much 
more conveni('nt form by getting a simpler equivalent for the 
cr- of the denominator. 

This <r* is the square of the standard deviation of a set of » 
continuous rtuiks. 

n 

/I + 2 -b 3 -f 4 4- • • • + n\* 

\ " V '•‘■7 

For the sake of an abbi'cviatod not,ation we may use Sn* to 
K'present the sum of the squares of all numbers to w, 

(I* + 2* + -b • • • -b n*), 

and Sn for the sum of the numlx^rs 1 to n. Our fonnula for the 
standard deviation of n continuous ranks will thou stand 



Our hardest job will bo to get a value for Sin®. We shall 
attack tlxat first. Lot us write down l.he following idtuitity; 

(» -b 1)» -• n» * (n» + + 3» + 1) - w» 

or 

(n + 1)» - n* « 37t» -b 3n -b 1 

This statement is true for all values of n, since it is an identity 
by soiection. Therefore, wo may replace n by (n — 1) and still 
retain an identity. That is, we shall have 

[(n - 1) + 1]* ~ (n - 1)» « 3(n - 1)* + 3(n - 1) 1 
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or 

r? — {n — 1)® = — 1)® + 3(n — 1) + 1 

If again we replace n in this expression by (n — 1), we shall 
obtain the identity 

(n - 1)® - [(n - 1) - 1]® = 3 [(k - 1) - 1]® + 3[(r^ - 1) 

— 1 ] + 1 
or 

(n — 1)® — (n — 2)® = Z(it— 2)® + 3(n — 2) + 1 

etc. In general, then, we shall have a set of statements which 
are identically true. These statements may be written as follows : 

(n + 1)® - n® = 3n® + 3n + 1 
n» - (n - 1)® = 3(n - 1)® + 3(7i - 1) + 1 

(n - 1)» - (n - 2)» = 3(n - 2)® + 3(n - 2) + 1 

(n - 2)® - (n- 3)® = 3(n - 3)® + 3(n - 3) + 1 

(n — 3)® — (n — 4)® = 3(n — 4)® + 3(n — 4) + 1 


[n — (n — 2)]® — [n — (n — 1)]® = 3[n — (n — 1)]® 

+ 3[n - (n — 1)] + 1 
or 

2® - 1® = 3 ■ 1® + 3 • 1 4- 1 


Now if we add these identities we shall, of course, obtain as 
the sum another identity. Making the addition, we notice 
that certain terms cancel each other. On the left side of the 
equation we shall have uncanceled only the first and the last 
terms. On the right none will cancel. But in the first term 
the quantity in parentheses starts at n and decreases by 1 down 
to 1, so that, when we add the first terms for all the equations, we 
shall have 3Sn®. For the same reason we shall have for the 
second term on the left 3Sn. There is in the third term a 1 
for each of the n equations, so that the sum of these will be n. 
The summing will, therefore, ^ve us the equation, 

(n + 1)® — 1® s= 32)»® + 3S» + n 


or 


ji® 4* 3w® 4“ * 3271® 4" 3271 4" w 


27t equals, of course, half the sum of the first and the last term 
multiplied by the number of terms, i.e., 
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Substituting this valuo, transposing so that wo may have on 
the loft side of the equation the Znr (for which we are seeking 
a vahi<0 and all other terms on the right, clearing of fractions 
by multiplying through the equation by 2, and then factoring, 
wo have the following; 

+ 32Jn + ti 

ZZn- = + 3'«. - Zn « 

6Stt* = 2tf + 6n- + dll - 3«.(n + 1) - 2n 
eSTt* = 2n^ + en* + Oft - 3 m» - 3ft - 2n 
OSft® = 2ft" + 3ft- -f ft 
6Sft* = ft(2ft"- + 3ft + 1) 

6Sft» = ft(2ft -I- 1 )(m + 1) 

■y„2 _ «(2ft ■+■ IK« + 1) 


Ropcfttanj?, now, our formula for tlu' varianop of a sot 
of ranks, suhstil.uting in it the values of i!?)’" and (d which 
wo found in the above proceas of reasoninK, an<l simplifying 
algebraically, we have 


^ n(2n + l )(ft + .1) _ fjHn -bjO* 
n \ ft / 6ft 4ft® 

(2n» + 3n -1- 1) _ (n® + 2n -M) 

C ~ 4 ‘“” 

4ft® + 6ft + 2 - 3ft* - 6n - 3 
"" 12 ' 


^rh% 


ft® - 1 
12 


(Formula for tho ataiulartl deviation /lyvs 
wiuared of a set of n ranks) 


Wo are now near the end of our thwelopmont. Wo shall 
repeat formula (46), from which wo starU'd, but shall sulwtHuto 
p for r in recognition of the fact that wo are dealing with ranks 
instead of raw scores, and then simplify our formula algebraically. 

_ 1 SD* _ , XD * 

p « 1 - « 1 - aFCivi-inj - 1 - -no 

§ 

ml — (CkuTolation formula from ranka) (81) 
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From this formula, it may be remarked parenthetically, we 
may easily derive a general formula for the standard deviation 
of any rectangular distribution. If we regard the length of 
the rectangle as divided into n equal intervals, the length of 
the rectangle will be the sum of these n divisions. If a is the 
frequency in each interval (in a rectangular distribution the 
frequency must be the same in each interval), the standard 
deviation will be, when squared, 




San- __ / SanV ^ _ a^S? r ^ ^ _ /^V 

an \ an J an ahi^ n \n J 


which is just what we had to begin with in the above develop- 
ment. The standard d eviation o f the rectangular distribution 
will, therefore, be V (n^ — 1)/12. Now, if we let the number 
of subdivisions increase indefinitely (by allowing our intervals 
to become indefinitely small), so that we eliminate the inaccuracy 
resulting from grouping the contents about the mid-points of 
intervals instead of taking the items in their proper places, the 
1 will become negligible in comparison with the n‘*^. Conse- 
quently, if we replace by as the limit is approached, (n^ — 1) 
will approach and we shall have 



(Formula for the standard deviation 
of any rectangular <listribution) 


(52) 


Thus the standard deviation is times the length of the 
rectangle. 

Returning to our principal development, it will be observed 
that the formula for p is merely a transformation of the formula 
for r. The p is therefore substantially equivalent to r. The two 
would be identical if it were not for the fact that something is 
lost in accuracy when translating scores into ranks, because ranks 
are equally spaced while scores seldom are. Pearson has given 
a formula for translating p into r. It is as follows: 


r = 2 sin (g) p (Formula for translating p to r) (53) 

The ir here is in radian units for measuring an angle and is 
equivalent to 180°. This 180° divided by 6 always gives 30°, 
so that one needs each time to multiply 30° by his obtained 
p, to look up in a set of trigonometric tables tire sine of the 
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resultant angle, then to take r as twice this sine. Suppose p 
turns out to bo 0.10. This 0.10 times 30° equals 3°. Looking 
\ip in a table of trigonometric functions the sine of 3°, we find it 
to be 0.05234. This multiplied by the 2 called for in our fonnula 
gives the value of r to the nearc.st third (h'cimal place 0.105. 
Suppose p is 0.50. Thirty degroe.s multiplied by 0.50 gives 15°. 
The sine of 15° is 0.25882, and twice this is 0.5 IS, which is the 
equivalent value of r. If p is 0.07, this times the 30° gives 29.1, 
which equals 29° and 6'. The siin; of this angle is 0.48634, and, 
consequently, r Ls 0.973. 

In many texts in statistics, tables are printed giving the 
equivalents in r for each value of p. But Pearson’s correction 
fornuila is based upon the assumption of a large normal distribu- 
tion in each of the corrtiaU'd serins in which the scores cor- 
responding to the ranks are found. The distributions from which 
the ranks for the computation of p are nearly always tak<m are 
very small and rarely if ever completely normal. Pearson’s 
correcition would seem them, to bo inapplicabiti in the practical 
sitiuitions in which we employ p; although on the average from 
many applications wo would Ixi nearer tihe truth wit h the applica- 
tion than without it, in any particular case wo could not ho at 
all sure that we were tu'arer the truth afttsr wo had applied it 
than before. Besithw, the correction Is luwer greater than 
0.018, and that is practically always well within the probabk* 
error of the comilation coeffi(dcnt. p is often considerably in 
error as companxl with r, due to loss in twicuracy in tlu! translation 
of scores into ranks, hut this is a loss that can never bo regained 
by this correction formula or by any other, W o advise, therefore, 
making little or nothing of the differonco between p and r and 
only employing the symbol p to indicate that the correlation was 
computed by the cruder ranks method. 

The ranks method may bo employed where the number of 
cases is small, since with a small number of cases Miy coefficient 
of correlation shows only roughly the degree of actual relation 
between the areas sampled and the crude ranks method serves 
the purpose sufficiently well. But, whenever the number of 
pairs goes beyond about 30, the labor of translating scores into 
ranks is greater than the saving from the simpler mathematical 
processes involved in the ranks formula. For that reason the 
Spearman ranks formula is not advised except perhaps where 
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N is less than. 30, unless the original data are ranks instead of 
scores. But this is only a matter of convenience. There is no 
truth in the idea that the Pearson product-moment formula 
is less applicable to a small number of cases than the Spearman; 
the two formulas are merely different algebraic forms of the same 
thing, so that, wherever the one is applicable, the other is also 
applicable. 

There is another correlation method based on ranks that is 
usually treated in books on statistics which we shall mention 
here merely to dismiss. It is called the foot-rule method and the 
coefficient derived by it is represented by the symbol R. It is 
not equivalent to the Pearson product-moment r but requires 
tables for translatioir. It seems to have no merits to recom- 
mend it, not even the ease of computation that some persons 
claim. We do not recommend that research workers learn it. 

ASSUMPTIONS ABOUT THE SHAPE OP THE DISTRIBUTIONS 
IN THE r FORMULA 

If the reader will recall our calculus development of the 
Pearson product-moment formula for r, he will notice that no 
assumptions whatever were involved regarding the shape of the 
distributions in the correlated scries. The formula is general; 
it holds for distributions of any shape, r’s may be computed 
between two series of percentiles, in spite of the fact that these 
make a rectangular distribution. If the regular product- 
moment formula were applied to two sets of correlated ranks, 
the resulting r would be identical with that gotten by the Spear- 
man method. The regular product-moment fonnula may 
be applied where one array is given in scores and the other in 
percentiles or in ranks. Kelley recommends^ that, whore one 
set of scores is known only in terms or ranks and the other in 
actual scores, a regular Pearson r be computed between the two 
series as they stand rather than lose further accuracy by trans- 
lating the known scores into ranks. The Pearson correction 
formula, where p' has been calculated between a set of scores 
and a set of ranl^, is 

r = r=1.0W (54) 

^ KbUiBY, T. L., Statistical Method, The Macmillan Company, 1923, p. 
194. 
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But the correction here, too, is so small Ihui it is sear(a‘ly worth 
making unless the N is large. 

PREDICTING IN TERMS OF THE REGRESSION EQUATION 

Of what use is a co(‘ffieient of eorn^lation when computed? 
There are two uses it may s(‘rve; (1) t.o enahk^ us to infe^r th<^ s<H)re 
of an individual in a st^cond array fron\ our knowledg(' of his 
standing in a first array wit.h which this st‘cond oiic is corn^latcd 
by a known amount; and (2) to expn'ss the dc^gnu^ of ititts’n^lation, 
of concomitance, of community, b<dAvc<m two systcatis of vari- 
ables. Wo shall first consider the fornuu- of t.lu'st' applicjitions. 

At the opening of this chapter we saw that-, if t.\vo stu'itss of 
paired scores arc reflated, the seort's in tlu^ t>TU^ stMhss may be 
treated as a function of those in the otluu*. Also, if tlu^ relation 
is the simple rectilinear one with whi<*h we are th^aling in this 
chapter, any y score will be a certain multiph^ of the (correspond- 
ing a-'Sc.ore, provided each is measured froiti the m<‘an. *‘rhm 
multiplier we called 6, and for it we found a gimeral formula 

V Wrt/ 

6 = This b is, as wo said, tho slopo of tho lino that bt'st 

fiis th(! tread of the paired measurcH. It is callt'd tlio rrgrrmon 
covfficm^. If it is th(5 slope that <>ho straight liiu‘ makes with 
the * axis when it passes through tine suecjessive x values In sueh 
manner as best to fit tho corresponding y nu'asun's, w<( call it 
the coofficHiut of 1.hc regression of y upon x and designate it by 
byx. If it is tho slope that tho lino makes with rt'spt'ct to tho 
y axis when it passos through tluj suceessive y values in such 
manner as best to fit tho corresponding x nu'iisures, wc call it tho 
cooflBloient of rogression of ® on y and desigtiatii it by hgg. 

Our dovolopmoiit at tho opening of tho chapter showed that, 
when our terms aro taken as deviatioirs from tho moans of their 
respective arrays, 

, 2zy Sxy _ ffifig Zxy cr„ 

*'* "S®* N&i *" IVvJ ffaffy "" <fa 

But tho first part of this last terra contains tho formula for r. 
Substituting r for this value, we have for our regression coeffi- 
cient of y upon ®, 

&». ■* 

0m 


(Regression ooeffio!ent» y on x) (SS) 
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If in our calculus development we interchange y and x, so that 
we compute x in terms of y, we get, 


2y2 


(Regression coefficient, x on y) (65a) 


We may now revert to our original equation for a straight line 
y = and substitute it in the value that we have just obtained 
for 6i,x. 


ff (Regression equa- 

ifi = r — ' Xt and similarly Xi = r — • Ui tion in devia- (56) 
Vx ffy tion form) 

These are the regression equations in deviation form. From 
the former we can predict the most probable y score for an 
individual from a knowledge of his x score, and from the latter 
we can predict his most probable a; score from a knowledge of 
his y score. Suppose, for example, we know that the correlation 
between intelligence test scores earned at entrance to college and 
“point averages” attained in college is .40 and that a certain 
boy makes a score of 18 below the mean in the intelligence 
test. The cr of the intelligence test scores is, we shall say, 30 
while that of the “point averages” is 0.60. What point-average 
attainment may be expected of him? The anticipated point 
average is the y, the other elements in the equation we know. 

.40^ (-18) = -0.144 


The boy would, therefore, have indicated as his most probable 
score 0.144 below the mean. 

So far we have been dealing with the regression equation 
in deviation form. If we prefer, as normally we would, to handle 
it in terms of raw scores, we need only put for its equivalent 
(Xi — Mx) and for §,• its equivalent (ft — My), where the M’s 
are the means. Our regression equation will ihen be 


(?i {Xi - M.); f.- - (Xi - M.) + M„ 

The one for X would be symmetrical wnth this one for Y. 
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Let xis now illustrate the operation of this score form'^ 
regression equation. Let \is say the moan of our intelligonco 
i.csG scores is 100 and the a- is 30, the moan of the point averages 
is L40 and the cr is .60, while the correlation between the two 
scries is ,40. A certain boy makes a score of 82 in the intelligence 
test. What may he be expected to earn in point-average 
achievement? 

Yi = .40 ^ 82 + ^1.40 - .40 ™ 100^ 

Yi = .656 + 1.40 - .80 = 1.256 

These data arc intended to be for the same case as those of 
our illustration in the deviation fonn, and the ro.sult Ls the sumo 
in meaning as that we obtained there, as the reader can easily 
verify. The worker will likely be computing expeetaiions for 
many individuals at one sitting. The value in parentheses 
will be the same for all cases and may bo worked out once for 
all as far as a particular sot of data is concerned. Likewise the 
r((r„/cr*) may bo computed once for all the needed applications. 
The routine computations for individual cases will then bo very 
easy. 

Whenever wo employ one measure as a criterion of probable 
standing in another, we are interested in the regression equation 
as a tool for making our predictions for individuals specific 
rather than general. Wo employ aptitude measures, particu- 
larly, in this manner: general intelligonco tests, special prognosis 
tests, measures of social status, of character traits, etc. Wo have 
more or less vaguely in mind the element of prediction, too, 
when we are concerned with the reliability of a tost, for what 
we have at stake is the question of how nearly individuals may 
be expected to make the same scores upon repetition of the b^st. 
In connection with prediction of scores the question comes up, 
then, as one of major importance for us: How accurately can wo 
predict by the use of a regression equation? This extremely 
important problem we shall discuss next, and we shall develop a 
general formula for the standard error of such estimates. 

STANBARD BIUROR OP BSTIMATB 

Whenever a score is predicted for a particular individual by 
means of the regression equation, it is predicted as lying on the 
regression line. But an mspecrion of Fig. 14 and Table IX 
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will show that, in any problem where we do not have perfect 
correlation, by no means all of the actual y measures that cor- 
respond to a given x value lie on the regression line; they scatter 
considerably above and below this line. That phenomenon of 
scatter is, perhaps, most obvious when we examine a correlation 
chart where the data are grouped into intervals, as is the case 
in Table IX. As we go out along the X axis, we find a series of 
columns approximately normal in shape with their means at 
successively higher y values, and the regression line passing 
near the center of each column. The y value calculated to 
correspond with a given x value would lie at the point in the 
column where the regression line crosses. The fact that the 
column scatters from this point shows that many of the calculated 
y’s miss the actual values to the extent of the scatter of the 
columns. We wish to get a measure of the extent of these 
errors in estimating a y score from a known x score by means 
of a coejfficicnt of correlation. We shall, therefore, compute a 
standard deviation of these ‘^misses.” This is called the standard 
error of estimate^ and its symbol is 
Let y be a predicted score and y the score that turns out in 
fact to be the one paired with x. Then {y — y) will be the 
''error” in this particular case. Remembering that our x^a 
and our y^s arc being taken as deviations from their respective 
means and that (y -- y) will be in deviation form if the relation is 
a rectilinear one, since ^ will then be the mean of the column 
in which it occurs, and remembering our value of y from the 
regression equation, 




N 





N N <rl N 


In this we have the equivalent of and of <r’. If we multiply 
both numerator and denominator of the middle term .by cr,, 
we shall have for the part of the term containing Xxy the formula 
for r. Therefore we have 


vit. 






<rj — 2rVJ + rV*; <r^ 

cry-\/T 


r* 


* (tJ — rVJ s= (r*(l — r*) 
(Standard error of estimate) (68) 
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A probable error is 0.6745 times as great as a standard deviation 
(in a normal distribution, which we assume here). Therefore 

P.E.«., - 0.6745v„vT^ (58o) 

Let us now illustrate the application of this formula. We 
shall employ the same data as used previously in this section 
(page 111). 

For the boy of our illustration a point average of 1.256 was 
I)redictod on the basis of his intelligence test score, where the r 
was taken to be .40 and the (standard deviation of the point 
averages) to be 0.60. How accurate is the prediction? 

= o. 6 oVi“-^^^* = o.60\/i - -16 * o.eo-v/:!! = 0.55 

P.E.«t = 0.6745 - 0.55 = 0.371 

This last value means that the chances are 50 in 100 that a 
student’s actual point average will not differ from his predicted 
one by more than 0.371 but that, conversely, they are also the 
other 50 in 100 that the score will be missed by more than that 
amount. The value of <r„t means that in approximately two- 
thirds of the cases we may expect to find our prediction in error 
by 0.55 or loss, while in the other third our errors may be greater 
than that amount. In the case of our particular boy the chances 
are 1 to 1 that his point average will not be found to go above 
1.627 or below 0.885, while they are 2 to 1 that it will not go above 
1.806 or below 0.706. 

That is really not very accurate predicting. It requires a 
very high coefficient of correlation to enable us to forecast the 
standing of individuals with reasonable accuracy. If we had 
no means of predicting a score at all, but merely drew for indi- 
viduals scores at random, the y scores for any given x value would 
scatter purely by chance; i.e., they would scatter for any * value 
to the same extent to which the scores of the whole test scatter. 
To the extent to which a correlation coefficient instead of chance 
guides us in predicting scores, to that extent the actual J scores 
for a given x value will have a smaller scatter, and with a perfect 
correlation coeffiicient as a guide they will all lie exactly on the 
regression line ; there will be no scatter at all . Where the y scores 
are collected into columns, as they are in Table IX, this relation 
is very obvious. The length of a»y column shows the extent 
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of error in the prediction, and its shortness as compared with the 
column of totals at the extreme right indicates the improvement 
we have made over chance by reason of the guidance afforded 
by the correlation coelB&cient. We may conveniently make a 
ratio out of the scatter of a column and the scatter of the whole 
distribution, and this ratio will show the proportion of chance 
still remaining in our prediction. We shall call this ratio fc. 
Then 


h = 



= \/i "" 


This ratio Vl — Kelley has named the coefficient of alienation. 
It furnishes a veiy fruitful way of looking at a coefficient of 
correlation and of passing judgment as to how high a correlation 
must be in order to bo satisfactory. The student should apply 
this test to coefficients of vai'ious sizes. He will find that, 
where r equals .10, there remains 99.5 per cent of guess in a predic- 
tion based on it; the prediction has been improved only one-half 
of 1 per cent over pure chance. Where r is .80, 60 per cent of 
chance still remains; we are only 40 per cent better off than if 
we drew predicted scores out of a hat. Even where r is .95, there 
remains 31 per cent of the element of chance in predicting place- 
ment of individuals. It is obvious that for the safe placement of 
individuals very high correlation coefficients are required — much 
higher than those called high by Rugg and others. 

If we are concerned with the prediction of averages for a 
group rather than with scores for individuals, much lower 
correlations may serve our purpose. We shall later see that the 
standard error of a mean of a group of y scores predicted on the 

0‘y 

basis of a correlation is V 1 — Thus the error of 

prediction of means of a class of 100 members would be only 
ono-tenth as great as that involved in the prediction of standings 
of individuals. 

The high residual scatter of y scores for a single x range, as 
shown by the coeflSicient of alienation, shows that we can place 
a subject only very roughly in a second measure from a knowledge 
of his score on a first measure, unless the coefficient of correlation 
between the two measures is very high. But a further considerjt- 
tion wiU show that we can have considerable assurance against 
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expectation of extreme shifts even when guided by relatively low 
r’s. Let us, therefore, ask what are the probabilities of reaching 
certain critical positions in a second array when position in a 
first array and the r between the arrays are known. Lot us 
return to the case of the hypothetical student of our above 
discussion who made 82 on the intelligence test and ask what are 
bis chances of making honors in college, which requires a 2.5 
average or better. He belongs to a subarray of students for 
whom the predicted mean is 1.256. The standard deviation of 
this subarray (column in the correlation chai't) is the standard 
error of estimate, 

Vo = ay's/! — = 0.55 

He aspires to reach a point average of 2.50, which is 1.244 points, 
or 2.26 of the standard deviations of his subclass, above the mean 
of his subclass. Will anybody in his subclass rise iis high a.s that? 
Yes, whatever percentage in a normal distribuiion lies 2.26v’.s 
above the mean. Reference to the table, page 480, shows that 
0.0119 will do so. Thus he has about 12 chanct's in 1,000 to 
make honors. But, conversely, there are in the subclass 0.9881, 
or 98.81 per cent, who fall below that critical point; so that there 
are about 988 chances in 1 ,000 that a student making his intel- 
ligence tost score will not reach the honors hsvel. The odds, 
therefore, that he will not make it arc 83 to 1 (obtained by 
dividing the chances against by the chances for). Suppose, 
next, wo raise the question: What are the odds that ho will make 
the minimum for graduation, a point average of 1 .00? This is 
below the predicted mean for his subclass by 0.266 points, which 
is 0.46v. The probability that ho will fall below this point is 
0.3228 and the probability of being above it is 0.6772, so that 
his chances of making the minimum grade of graduation aro 
roughly two to one. 

Wo give, on pages 508 to 610 of the Appendix, a table showing 
the chances in 1,000 of passing from each tenth in a criterion 
array to each tenth in a predicted array for r’s by .lO’s from 
.06 to .95. Of course, for an r of 1.00 the prediction would 
be perfect. The prediction is made from the mid-point of 
each tenth in the criterion to just across the border in the depend- 
ent array. Thus, the chance of shifting from the 4th tenth in 
the criterion to the 6th tenth in the dependent array means the 
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chances in 1,000 that a student who stands on the 45th percentile 
in the former array will be found above the 60th percentile in 
the latter array. 


r IN TERMS OF COLUMN VARIANCE 
The reader is asked to think again of Table IX, where the 
data of the correlation table are gathered into columns. These 
columns tend to have the same degree of scatter. Equal vari- 
ability in the columns of a correlation table is called homo- 
scedasticity, and the assumption of homoscedasticity is often 
made in the development of statistical formulas. If we assume 
it here, as we have been doing in this section, we can take the 
standard error of estimate to be the standard deviation of any 
one of these columns. We can then make some interesting 
algebraic transformations. Let us call the standard deviation of 
any column <rc. Then 


^2 


cTo = CyVT^^-, - r^) = <rj - rV* 




(Coefficient of determination) 


(59) 


This makes obvious the relation between the scatter of the 
columns and the coefficient of correlation. Conceivably we 
might compute an r from this formula. However, the fact that 
Ve is the standard deviation of the column from the regression 
line as origin rather than from the mean of the column makes the 
computation of an r in this manner impractical unless perfect 
rectilinearity of regression may be assumed. But we shall later 
see that another measure of correlation, ij, makes use of just this 
procedure, except that there we compute a-e from the means of 
the columns. 

An equation involved in the above development puts us in 
position to prove that an r must always lie between 4-1-00 and 
and —1.00. You will find above the expression: vj == <rj(l — r“). 
Now <r* (if it differs from zero) must be positive in sign, since any 
tr® is made up of squared measures which are always positive if 
the measures are real. For the same reason <r} on the right-hand 
ade of the equation must be positive. Therefore the (1 — r®) 
must be positive (or zero), since otherwise the sign of the product 
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on the right would have the minus sign and would need to be 
a negative quantity. But (1 — r®) can be positive only if r 
docs not go above +1.00 or below —1.00. I’hcrefore r must 
lie between plus 1 and minus 1 inclusive. 

We have now shown how a coefficient of corrclafion can be used 
in the prediction of scores in an array that is not yet in hand but 
with which the correlation of a criterion is known on the basis 
of past experience, and wo have seen the limitations of accuracy 
of these predictions in terms of the standard error of estimate 
and of the coefficient of alienation. We have next to discuss 
the other use of an r, viz., to express the degree of community 
between two sets of data. 

DETERMINING AMOUNT OF COMMUNITY BY CORRELATION 

In analyzing the “inductive methods” employed in scientific 
inquiry, John Stuart Mill listed as one of them iho method of 
concomitant variation. When the height of the mercury column 
in a thermometer rises as the temperature becomes higher and 
falls as the temperature lowers, a causal relation between these 
two concomitantly varying phenomena is indicated. If certain 
electrical disturbances are found on the earth simultaneously 
with spots on the sun, not only occurring simxiltaneously with 
the latter or else with a fixed lag but also varying in intensity 
as the latter vary in intensity, a causal connection is likewise 
indicated. Correlation in statistics is similarly merely a mathe- 
matical method of making more specific this matter of con- 
comitance of variation between two sets of variables. It 
is, therefore, one of our methods of attempting to establish 
“laws” and to get at causal relations whore the problem of 
isolating single variables is difficult or impossible. For a “law” 
is merely a description of concomitance of behavior between 
two or more factors when the existence and the nature of that 
concomitance have been supposedly infallibly determined; and 
causality is merely another name for such concomitance where 
we believe we know the direction of influence. In the physical 
sciences it is often (though not always) possible to isolate the two 
independent factors, and thus to determine the relation between 
them in a manner that will not vary from sample to sample. 
But in social phenomena we must ordinarily be content to let 
some irrelevant elements drag along mixed up with either or 
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both of the variables we are attempting to study, and these 
obscure the nature of the relation between our variates under 
study and cause the measurable kind and amount of concomi- 
tance to vary somewhat from sample to sample. The correla- 
tion technique is a very powerful device for analyzing such 
concomitance. 

Since the measured concomitance between the variables will 
differ somewhat from sample to sample because of the presence 
of irrelevant elements which weight our scores, our first concern 
is to know whether there is in fact a real connection between 
our variables. When we study reliability in a subsequent 
chapter, we shall find that, even if there were in the total popula- 
tion a true correlation of zero, we wwild get r’s differing from 
zero in samples, some positive and some negative, and that the 
standard deviation of this set of r’s could be estimated from the 
formula 

1 - 0^ _ _ J 

- 1 vn~^ 

Tkus, if the sample contained 65 cases, the standard error would 
be .125. So an r as large as +.126 could be expected to occur 
merely by chance fluctuation fi’om uncorrelated populations 
about one time in seven (1,587 in 10,000), and one of —.125 
equally often; one of +.25, 228 times in 10,000; one of +.375, 
13 times in 10,000; etc. So, if one has obtained from a sample of 
this size an r of +.125, or even of +.25, there is considerable 
risk in asserting positive correlation because the obtained r 
might have arisen merely by chance fluctuation. It is conven- 
tionally said that, in order to give assurance that there is a true 
correlation in the direction indicated by the sign of the one 
obtained in the sample, an obtained r should be at least three 
tinaes as large as the standard error. We shall later show that 
this notion can be easily overworked. What we have is really 
different degrees of probability of an actual connection when the 
ratio of an obtained r to the standard error is certain amounts. 
If the sample is reasonably large and the ratio of the r to its 
standard error is 1, the odds are about 6 to 1 that there is n true 
r between the two sets of variables somewhat above zero in the 
same direction as that of the sample; if the ratio is 2, the odds 
are about 43 to 1; if 3, the odds are about 740 to 1; if 4, about 
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32,000 to 1; etc. Moreover, if several successive samplings 
give r’s with the same sign, the probability that there is a true 
correlation with that sign is greatly increased. Even if the r’a 
are prevailingly, though not exclusively, of one sign, an r with 
that sign is indicated with a reliability for the sot that is likely 
to be considerably higher than the reliability indicated by the 
samples considci'cd separately. We shall discuss and illustrate 
this point at length in a later chapter (pages 469 to 474). 

Our first concern, then, in studying the commutiity between 
two sets of variables is to have a.ssurance that there is a real 
correlation between them; and this we determine, as we have 
shown, by finding whether the relation of an r to its v is 
sufl&ciently high to guarantee this. Our second concern is to 
find some meaningful way in which to express the amount of this 
community. This we shall do by interpreting r in terms of the 
percentage of overlapping between the two mcipiuros. 

A Coefficient of Correlation as Proportion of Overlapping. — 
Suppose that a set of c elemental factors contrihui.e l.o both Hc,ore.s 
X and y, while there are additional elemental factors, a, that 
contribute to x but not to y, and b factors which contribute to 
y but not to x. We would then have x — a + c and j/ = 6 + «• 
Factor c is correlated with both x and y; but the other ekunents 
arc independent of each other and of c. 

If we measure x and y as deviations from tlunr re,spectivo 
means, ihe sums which equal those may bo regarded as measured 
from their means and also the constituent addends from thtar 
respective means. Then 

r * « 2(c + a)(c + b) ^ Sc^±J'c6Ji2ca 4^Sob 

^Cliffy Wv 4-rt<r o+6 

But since c and a, c and h, and a and 6 are Independent of one 
another, and since each is in deviation form so that when summed 
alone each yields zero, the sum of the products in each of the last 
three temos of the numerator would approach zero, and these 
temos would drop out of the equation. We would have left 

2c* 2c»/JV <r* 

* iY<ro.fttO'o+& <Ta>^aO‘c^'b 

It can easily be shown that, since the series o and c are uncor- 
related, ff«+o equals as follows: ' 
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N 


23 

and ffl = whence cl — 


1,c^ + Sa® 
N 


Since o and c are uncorrelated and are in the form of deviations 
from their respective means, 2 Sac will equal zero. Hence we 
can insert that value in the numerator of our fraction without 
changing its value. 

, . , Sc* + 2Sac + So* S(c + o)* . 

0^1 + = <<. 


Therefore Cc+a = Ver- similarly = VcTc + cr}^ 

Making this substitution in our equation above, 

r = — ^ (60) 

Vci + ci-s/^T4 

Let us now' assume that cl equals cl. That is to assume 
that there are as potent factors accompanying the x variable 
that contribute to the total variance but not to the correlation 
as there are accompanying the y variable. This is not a violent 
assumption, but, even if it does not hold strictly true, that fact 
would not appreciably vitiate the conclusion we are about to 
draw. Making this assumption, the two terms under the 
radical sign become alike, and their product gives us one of them 
with the radical sign removed. Making this adjustment and 
then availing ourselves of the converse of the showing made above 
about the relation of to cl + c\, we have 


r 


4-<r* 



(60a) 


Let us call aj the variance duo to the common factor and 
<rj+a ■fch® total variance. Our results, then, mean that the 
coefficient of correlation between two arrays is <Aa< fro^ortion 
of the total variance which is dm to the common factor present in 
each test.^ 


> Compare Kelley’s development, InterpretaMon of Educational Meaawc- 
mmU, pp. 193-105. In our development we took no cognizance of the 
possibility of imperfect measurements of * or y, which if present would 
vitiate some of our assumptions. Hence the &ding holds strictly for r 
only when » and y are perfectly measured, i.e., for the “true” r, the r “ooi> 
rected” for “attenuation." 
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We may put this into more meaningful form if we make some 
fairly well-waiTanted assumptions about the nature of our 
a, bj and c factors. Let us suppose that the 6 * factors in any one 
item (score) are elemental units equal to one another in potency 
and any one of them equally likely in a given ii.cm to be present 
or absent. Let us make similar assumptions about b and a. 
These assumptions square readily with the behavior of deter- 
miners” in controlling traits and with the Mendolian laws of 
heredity. The number of c factors will then vary from item to 
item in such manner that they will make a normal distribution 
with the mode at half the maximum number. Wc shall learn 
in C hap. X that the standard deviation of a point binomial 
is 's/pqn. In this case both p and q arc 0.50 and the n is the 
aggregate number of c factors in all the scores combined, which wc 
shall call nc- Therefore 

cTo = *\/0.50 • 0.50nc = O.SO-v/n^ 

and similarly era = O.SOv^ and erb — 0.50\/ ^. B y utiliasing 
the principle, developed ab ove, th at 0 - 04.0 = 'x/o’J + cr* we would 
have likewise = 0.50 Vn7+^ and 0*046 == O.SO-x/” + %• 
Substituting these values in our formula (60) for r obtained above, 

^ , ( 61 ) 

0.50-\/no + rioO.SO'N/ We + nj, (n. + no)(wc + nb) 


If now we assume that no equals m, which is similar to tho 
assumption we made in our development above, our equation 
would become, 


fie 
n, + 


(62) 


Put in words this means that, if there is as much of tho measured 
factor X that is not y as there is of measured y that is not z, 
the coefficient of correlation between x and y expresses tho 
percentage of overlapping between the two universes. 

Suppose now that b equals zero; i,e., suppose that all of y 
is included within z but not all of a; is included in y. We would 
then have 


r «s 




:r* 


n; 


M. 


V(«* + i»a)n»’ (n. + n«)no n. 4 «a 


(63) 
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That is, if all of y is included in x but not all of x is included 
in y, the percentage of overlapping is equal to the square of the 
coefficient of correlation between x and y. We would have the 
former condition fulfilled if some factors in measured intelligence 
contributed toward attainment in scholarship while some others 
contributed toward leadership, toward social graces, etc., but 
not toward academic scholarship; if scholarship, conversely, 
were due in part to the intelligence factor that the tests can 
measure but also in part to the social status of the home, to 
health, and to accidents of morale; and if the collateral factors 
in intelligence were equal in number to the collateral ones in 
scholarship. The r would then be the percentage of overlapping 
between measured intelligence and measured scholarship. We 
would have the latter condition fulfilled if all of study hours 
contributed toward scholarship but scholarship were due not only 
to study but to some other factors in addition. Here the square 
of the coefficient of correlation betvreen study hours and scholar- 
ship would give the percentage of overlapping. 

Since the “true” r involved in our formulas is always a little 
greater than the r obtained from fallible measurements, while 
the square of the true r is likely to be a little less than the obtained 
one, and since the conditions obtaining in life are usually some- 
where between those of our two assumptions, the coefficient of 
correlation may be regarded as fairly descriptive of the percentage 
of overlapping between the two universes correlated. The size 
of the correlation shows us the extent to which the factor x is 
adequate to account for the factor y — the percentage of the 
behavior of y that is attributable to x — or the reverse. 

Exercises 

1, From the data of Table X, page 124, determine the relation between 
size of school for defectives and the economy with which such school can be 
run, where economy is measured in terms of cost per pupil. 

2. If you have used the Pearson product-moment formula in Exercise 1, 
turn the scores now into ranks and compute p. Compare it with r. 

8. Compute the standard error of estimate for the r of Exercise 1, and con- 
cretely interpret its meaning. 

4* Compute r*B between one or more pairs of columns in Table IV, pages 
58 to dl. 

5 . Recompute one or more of the r's of Exercise 4 using only five intervals 
in each array. Compare with the r's from the individual pairs of scores, or 
from 15 or more intervals. Make Sheppard's correction in the <r's of your 
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Tablb X. — Pee Capita Costs and Eneoelment in 45 Public Residential 
Schools foe Deaf Childben in the United States^ 


Name of school 

Clarko School for tho Deaf, Masaachusotts 

Pennsylvania State Oral School for the Deaf 

New Jersey School for the Deaf 

Columbia Institution foi tho Deaf 

North Dakota School for tho Deaf 

Mystic Oral School, Connecticut 

New York Institution for tho Deaf and Dumb 

Pennsylvania Institution for the Deaf. . 

Western Pennsylvania School for the Deaf 

Iowa School for tho Deaf 

Rhodo Island School for the Deaf 

Northern Now York Institution for Doaf-mutoa 

Beverly School for tho Deaf, Masaachuaetts 

Institution for tho Improved Instruction of Deaf-Mutes, N, Y 

Central Now York School for the Deaf 

California School for the Deaf 

Missouri School for the Deaf 

Florida School for tho Deaf and the Blind 

Rochester School for tho Deaf, New York 

American School for tho Deaf, Connecticut 

Wisconsin School for tho Deaf 

Illinois School for the Doaf 

Kansjis State School for the Doaf 

Maryland State School for the Deaf * 

St, Joseph’s Institute for Deaf Mutes, Now York. 

South Dakota School for the Doaf 

Le Couteuix St. Mary’s Institution, New York. 

Minnesota School for the Deaf 

Nebraska School for the Deaf 

Washington State School for the Doaf. 

Texas School for the Deaf 

Xiouisiana State School for the Deaf. 

Indiana State School for the Deaf 

Oklahoma School for the Deaf. 

Kentucky School for the Deaf 

Michigan School for the Deaf. 

Oregon State School for the Deaf. 

Ohio State School for Deaf, 

Arkansas School for the Deaf. 

Maine School for the Deaf * 

Alabama Institute for the Deaf and Blind. 

Tennessee Bohool for the Deaf * 

Georgia School for the Deaf 

Mississippi School for the Deaf. 

North Carolina School for the Deaf. 


Enroll. 

ment 

102 

a«o 

207 

111 

122 

OOO 

000 

300 

301 

00 

104 

81 

254 

110 

207 

307 

230 

220 

223 

220 

590 

221 

175 

410 

m 

220 

324 

204 

152 

510 

214 

443 

803 

337 


477 

120 

524 

828 

122 

884 

884 

201 

252 

870 


Per 

capita 

costs 

10 
35 
70 
07 
33 

754.40 
725.13 

005.21 
050 02 

044.05 

044 , 80 
020.20 
010.90 
017.32 

011.77 

003.00 
500.50 

585.77 

570.28 
500.54 

530.52 

521.20 

518.40 

514.01 
512.45 

511.74 

470.37 

401.24 
450.08 
441.42 

408.25 

808.41 
880.00 
382.72 
879.82 

865.05 

860.22 
857.87 
856,58 
854,62 

884,07 

808.16 

805.69 

299.28 
291,95 


i$l,l47. 

878. 

847. 

823. 

707. 


1 After S, G, Crayton, Batt., Unit* Ky» Btir, School Scrticct Vol, 7| No, 1« pp, 122«*128« 
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r formula as applied to the five-category problem, and then compare your 
r with the one from narrow categories (see page 397). 

6. From a sample of 30 or 40 pairs, compute an r by the sums and by the 
differences methods and compare the convenience of these methods with 
that of the Pearson product-moment method. 
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CHAPTEK V 

RELIABILITY OF STATISTICS 
STANDARD ERROR OF A MEAN 

Variability in Means* — When we take the mean of a group, we 
are customarily taking the mean of a sample out of a larger 
population. We may, for example, get questionnaire returns 
from 100 individuals declaring their several incomes and compute 
from these the mean income for the group. This we would 
characteristically wish to take as evidence of the average income 
of the whole population from which we drew the sample. Simi- 
larly we might wish to get some evidence of the extent of general 
information possessed by the high-school pupils of our city 
and might content ourselves with administering a tc>st of general 
information to several hundred of these, on the faith that what 
we learned about these hundreds would be fairly rc^presentativc 
of the whole city. Even if we test all the individuals of a given 
set, our findings still constitute essentially a sampling, since to 
get a complete picture of the situation, we would need to retest 
the group for all sorts of possible changes of conditions. 

As we draw other samples from our population, the obtained 
means are likely not to be precisely the same as the first one. 
From our second 100 respondents regarding income, and from 
the third, and the fourth, etc., our means would fluctuate some- 
what, The same thing is true wherever we employ samples, 
even where we retest the same group. It may bo of much 
importance to know how great shifts to expect in further samples, 
since such knowledge would permit us to know with how great 
confidence to accept the mean we have in hand. One way 
would be to draw very many samples and to compute theii 
actual means in order to learn empirically how stable these means 
are. But ordinarily that is not feasible; it is too expensive in 
time and money. But fortunately statistical principles permit 
us to infer the extent of this fluctuation theoretically from data 
furnished by our single sample. Such theoretically inferred 
standard deviation of means from possible further samples ijs 
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called the standard error of the mean to distinguish it from a 
standard deviation that has been empirically computed. In 
this section we shall develop the formula for this measure of the 
reliability of a mean. 

Development of the Formula for the Standard Error of a Mean. 

Let us conceive our measures as deviations from the mean of all 
the means of a great many random samples, say 8 samples. 
Then for the value of the deviation of the mean of any one 
sample from the mean of all the means we would have 

M = + ^2 + a ;3 + ‘ ‘ 

^ n 

\ 

where the re’s are the individual measures and n is the number 
of them in the set. Squaring for this mean, 

jyr2 _ (re 1 4 " 3^2 + 3:3 + • • • + rCn) ^ 

1 ^2 

_ ref + rc| 4 ” 2:3 + * * * 4 " + 2rcire3 4 " * ’ * + 2x2rc3 4 " * * * 


We may write this 


n^M\ == X ^ X X ^ 

1 1 j* 1 

where the symbolism in the cross-products term means that each!^ 
item, as Xi, is combined with every other than itself in the sample 
and that each of the items, xi,x-t, ... ,Xj, , x„, is similarly 
thxis combined with the others, all of them summed together 
constituting the tail of the expression. We shall have similar 
expressions for Mi, Mi, etc., though with what we must take to 
be different x’s. The standard-error-squared of the means is 
the sum of all the squared means divided by the number of means, 
which we have agreed shall be S. Summing all these sets of 
values together, we have the formula 



where now the symbolism in the last term indicates that the 
cross products are kept segregated by samples in summing, but 
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the values within the several samples are then summed for the 
whole set of iS samples. 

In the conventional proof, followed by Kelley, Jones, and 
others, it is claimed that the tail of this expression amounts 
substantially to zero, the following theorem being cited as proof:* 
The sum of products of measures which are independent of each 
other and whose means are zero, equals zero. Exit the proof ia 
invalid because the theorem upon which it rests is inapplicable. 
For, on the one hand, the means of the me(usui’o.s within the 
several sots in which the products are obtained are not zero 
but Ml, Mi, Ms, etc.; and, on the other hand, the products are not 
inclusive of all, since those of the typo are dcfinitxdy withhold 
and included in the Sa:*’s. We shall resort to a morcj round- 
about, but mathematically defensible, development to proves 
that the tail approaches zero as a value only xindcr xicrtain 
conditions. Meanwhile, noticing that ^M’‘/S is and clearing 
of fractious, we shall write our formula more simply as follows; 



We have said that 5 shoxild represent many samples. In 
order to exhaust tlui .situation and thus perfect our dovolopmemt, 
we shall make S all l.he possihlo different samples that (ian be 
drawn from a total population of N taken n ati a time. The.se 
samples must alway.s be diffxu'ont, bxit the slightxist possible 
difference will do — merely tlio change of a single x in thti wliolc 
set of n x’s. llcferenco to the treatment of the mathematics 
of choice in a textbook in algebra will show that the number oS 
combinations of IV things taken n at a time (consequently the 
numerical value of S) is given by the formula 

(m iy(ivr - 1)(N - 2)(Ar ~ 3)(W - 4) » • • (i\r - n H-l) 

^ ■' n(n — l)(n — 2)(n — 3){« — 4) ■ ■ • 1 

In the sot of fi! samples there will be, as implied above, duplioac 
tion of variates. How many duplications? Consider first 
the part of the expression containing H'Sx^. All the ®*’8 will, 
of course, appear in the summation as a whole, but not every one 
will appear in each sample. It will, however, appear as often 

‘ Kbllbt, T. L., Statuiieal Method, p. 84. 
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as combinations can be made of the other taken so as to 
leave room for it; i.e., the number of times it will occur is the total 
possible number of combinations that can be made of iV — 1 
things taken n — 1 at a time. In all of our future manipulations 
in this chapter we shall use formula (B) as the basic formula. 
To learn how many combinations can be made of iV — 1 things 
taken n ~ 1 at a time we need only substitute AT — 1 for i\r and 
n — 1 for n. Doing this we shall have, as the frequency with 
which each of the will occur, 

{N - 1){N - 2)(N - Z)(N ~ 4) - > (AT - n + 1) 

(n — l)(7i — 2)(?z — 3)(n — 4) • * • 1 

Since each of the will occur this same number of times, we 
may use it as a coefficient for the summation of all the 
Thus the first quantity in the right-hand member of our equation 
will have the value 

{N - 1){N - 2)iN - 3)(iV - 4) • • • (JV - n + 1) 

(n — l)(n — 2)(n — 3)(?i — 4) • • • 1 ^ ‘ 

iV 

where is the sum of all the different a:“’s in the whole 

r 

N population. 

We shall next deal with the treble summation constituting 
the second part of the expression in Eq. (4). In order to be 
able to substitute a known value for it later, we need to ascertain 
how many times each combination of elements, XiX,-, will recur 
in it. Within each sample there will be no duplication of paired 
terms, but successive samples will partly overlap and partly 
differ. So there will be duplications of a given paired element, 
just as in the case of the a^’s, but perhaps a different number. 
Let us see how many. 

Within each sample the number of different paired elements 
is the number of possible combinations of n things taken two 
at a time. If, in our basic formula (B), you will substitute 2 for 
n and n for N, you will find this number to be n(n — l)/2. The 
number of samples has already been given in formula (B) . There- 
fore, the total number of paired items in the whole of the tail for 
all the samples combined is the product of the number of samples 
and the number of items in each sample, viz., 
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N(N - 1)(JV - 2){N - 3)(JV -i) {N -71 + l)n(n - 1) 
2n(ft - l)(n - 2)(n - 3) • ■ • 1 

But the whole number of different paired items is the number 
that can be made from the whole population of iV taken two at 
a time. This, as appropriate substitution in formula (£) will 
show, is JV(Ar — l)/2. Since all the possible variates occur 
and with equal frequencies, the number of times each will occur 
is the total number divided by the number of different ones. 
That is, 

2iV(2V - 1)(JV - 2)(iV - 3) • • • (JV - n + l)wCtt - 1) 
2N(N - l)n(n - l)(n - 2)(n -"3) • 1 

Certain of these terms cancel out, leaving as the frequency 
of occurrence of each possible different pair, 

rn (jyr _ 2)(N - 3) ■ ■ ■ (N - n + 1) 

^ ' (n — 2){n — 3) • • • 1 

Abandoning that lino of development for the moment, wo 
may write 

(xi + icj + ars 4- ■ • • + + Xj + xj + • • • + Xat) = 0 


for each quantity in parenthesis sums all of our N items, and 
they aggregate zero because the measures were taken as devia- 
tions from the mean of the whole set. Multiplying out, 

X* -f- Xj -t" *1 4“ • ' • + 2xiXj 2 xiX 8 “b 2xix* 

-+-••• + 2x»xj 4* • • * *• 0 


H N N 

This we may write more briefly as x? -f 2 V XiXj *= 0. 

‘V <-1 y'-i 

N N N 

Therefore, transposing, 2 2/ XjX; * double 

summation involves the value for the sum of all possible products 
of different variates taken two at a time in a population of N 
K 

in terms of Xx|. Formula (C) gave the number of times 
y 

such systems of paired products recur in the treble summation 


of formula (A). Therefore the vaiue of the second part in formula 

A 

(A) is the product of the — ^ x| and the coefficient indicated 
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in formula (C). So, substituting in formula (A) the two coeffi- 
cients thus determined, we have 




{N - 1)(JV - 2) 
(n — l)(n 


{N -n + 1) 




(N - 2)(iV - 3) 
(n — 2)(n 


n -1- 1) 


iV 


Let us examine this expression closely. If we multiply the 
first of the members on the right by N/n, we shall have the 
equivalent of S, for we shall have the formula for the number of 
combinations that can be formed of N things taken n at a time. 
Similarly we shall have S as the coefficient of the second term 

_ 1 ) 

if we multiply by — • We can do such multiplying if 

we indicate a compensating division or (which amounts to the 
same thing) a multiplication by the reciprocals of these terms. 
Making these adjustments, we have 


We can do such, multiplying if 


Dividing through by nS and taking 7^x^/N out of the parentheses, 
we have 


JN 

. n-l\ 

<'« - jv V ^ JV - 1/ 


jLy 

But N is the number of items out of which X a:? is constituted, 

y 

since this has been so carried as not to include the duplicates. 

JV 

Therefore, is the of the whole iV population. Making 
this substitution and again dividing by n: 
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Now let N increase infinitely. Then the value of the frac- 
tion in the parentheses will approach zero in value and, in the 
limit, 

ffjJ = % and <tm = (Standard error of a moan) (64) 

n -y/n 


Notice that formula (64) has in its numerator 5, the standard 
deviation of the population. Of course, wo could never know 9 
and would need either to substitute for it s, an estimate of the 
population value, or merely cr, the standard deviation of the 
sample. On page 70 wo showed that 



Making that substitution, we have 

_ _ ffx / n 

■\/n 'sf n "N/tt ~ 1 


On 


■\/h 


(Standard error s 

of a moan) 


T h is (n — 1) instead of n always belongs thooret.ieally to a 
standard error of a moan. However, in cdu(‘.ational statistics 
we customarily neglect the distinction because our n’s are so 
largo that the subtraction of a 1 does not make an appreciable 
difference. While it is not worth the student’s trouble to make 
the correction in most staiastical practice, ho should remombor 
that it always theoretically belongs in his formula and should 
employ it whenever, in sufficiently trustworthy mciwures, his n 
becomes small enough that tho correction would make an appreci- 
able difference. 

Effect of Restricted Selection. — We wish now to direct tho 
attention of tho reader to tho (n — l)/(iV' -• 1) of formula (£>). 
For the formula to hold in tho simple way in which wo loft it at 
the close of our last paragraph above, tho N raiist bo very largo. 
That is not always tho case. Suppose, for example, you were 
taking samples of 25 pupils each from a total sot of 60 pupils. 
Here n would be half as largo as W. Disregarding the 1 sub- 
tracted from each, on tho ground that it makes little difference 
with numbers of reasonable size, 

9. r 26 9, , 

* We treat the reliability of small samples on pp, 171-176. 
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It is obvious that the limitation of the sampling here has a 
marked influence in decreasing the size of the standard error of 
the mean. In general, if we let p represent the percentage that 
the sample is of the whole population from which the samples 
are drawn, 

(E) CM = ^ VT^ 

Ordinarily the research worker will not have occasion to use this 
formula as here presented, but it is interesting and important as 
generalizing a principle we shall treat in our next paragraph. 

Standard Error of a Mean in Correlated Series, — In our 
previous section we saw that restriction of the population from 
which samples are drawn operates to reduce the standard error 
of the mean, making it •%/! — p times as great as it would be if 
the samples came from an unrestricted population. That is 
because the successive samples overlap one another to the extent 
to which they are crowded into a small total population. We 
have a special case of such restriction when the successive 
samples are matched with an initial one in a relation that involves 
correlation. We have seen (page 120) that correlation depends 
upon overlapping qf the correlated samples, but not necessarily 
because of narrow boundaries of the total population from which 
samples are drawn. Restriction due to correlation would 
happen, for example, when a class was retested with the same 
test or with a different form of the same test. It would happen 
equally certainly if a number of groups matched with an initial 
group for ability (say, on intelligence scores) were tested with 
the same test. In both cases the successive samples would 
fluctuate less, and hence have a smaller standard error, than if 
they had not been matched with an array with which they were 
correlated. We shall undertake to develop a formula for the 
standard error of a mean under this condition of correlation. 

Suppose we have a series of x scores and another series of 
y scores, the two sets being correlated. The x scores correspond- 
ing to y scores of a ^ven size would scatter so that their standard 
deviation would be cr,\/l — (see page 113). The »’s and the 
y’s may be any sort of units, including means. So the x means 
corresponding to y means of a given aze would scatter in such 
way that the measures of their variability would be, if Cm. is 
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the standard deviation of the moans of a random selection of 
samples and that of a column of means of samples belonging 
to a particular level of ability as measured by the matching 
test, 


But WO havo already shown in this chapter that a-m = — 

Vn 

and we shall shortly show (page 162) that rm,m, — Sub- 
stituting these values, we have (since the i subscript has been 
employed merely to indicate any particular level of ability at 
which we are matching so that we may now drop it from our 
notation) 


ffj! /V i (Standard error of a moan in the ease 

era = — v 1 — r" of oorrolatod namploH matched on a (65) 
V W fallible criterion) 

The r here is the coefficient of correlation between the matching 
element and the successive samples. In order to involve this 
principle, it is only necessary that the groups be matched for 
equality of means, since that will force correlation of individuals. 
However, the r could not be computed unless individuals were 
paired as well as means, though it might bo known from previous 
experience with the measures. 

We have treated the case where the matching is on a fallible 
criterion — ^the criterion measures having a certain unreliability 
which results in our accepting certain sample groups as matched 
with the others when, truly measured, they would not belong. 
We shall later see (page 207) that the scatter of correlated 
measures about the true scores with which they should be paired 
rather than about the fallible ones with which they appear to 
be paired is measured by oaVl — r. The same is true when 
our correlated measures are means. Our formula, therefore, 
where the matching is on a “true” criterion, would be 


ffM =» -%= VT — r 

vw 


(Standard error of a mean in the case 
of correlated eamples matched on an 
infallible oriterion) 


( 66 ) 


We would have such matching on a true oriterion where 
the same group was to be retested, for here the paired individuals 
axe the same persons, consequently truly paired as to ability. 
The variability of the means to be expected if we should repeat- 
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edly retest the same group is, probably, what we usually have in 
mind when we think of the standard error of a mean; hence 
formula (66) is the one most often to be used. The r here is 
the reliability coefficient of the test. If we have in mind the 
variability to be expected in case we should sample successive 
groups of the same mental age or of the same social status, we 
should use formula (65). Here the r would be the coefficient of 
correlation between our test and mental age or social status, 
either as determined by calculation in this case or as known from 
previous experience with the measures. If we have in mind 
the fluctuation of the means of random samples from our popular 
tion regardless of matching for equality in any factor, we should 
employ formula (64). One cannot speak with precision about 
the standard error of a mean unless he indicates whether he refers 
to a random sampling, to a sampling matched on a fallible 
criterion (as when one measures, say, the voluntary reading of 
pupils of the same average educational age), or to repeated 
testing of the same group (which involves matching on an 
infallible criterion). The use of the correct rather than an 
incorrect formula may make a vast difference. The standard 
deviation of the total score on the Stanford Achievement Test 
in the fourth grade is given by Kelley^ as 10 points and the 
mean as 32.7. A reliability coefficient of .89 is claimed in the 
test manual for this grade. By the conventional formula (64o) 
the standard error of the mean would be for a group of 37 pupils, 
10/\/36 = 1.7. By the correct formula it would be 



This latter is just about a third of the former. 

APPLICATIONS OF THE STANDARD-ERROR CONCEPT 
Having developed our formula for determining the standard 
error of a mean, we wish now to see what is to be done with it 
in a particular research situation. One use is merely to give a 
sense of the variability of the mean in comparison with the 
absolute size of the mean, just as the size of a coefficient of cor- 

* EBinsT, T. L., Interpretation of EdueationaL Meaeurementt, World Book 
Cbmpany, 1927, p. 198. 
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relation yields a sense of the closeness of relation between the 
correlated arrays. Therefore just to say that the mean is 47 
and its standard error is 4 is to some extent meaningful. But 
wc can make the interpretation much more meaningful if we make 
certain assumptions about the distribution of the means of 
samples and under these assumptions draw inferences regarding 
the probability that the true mean docs not lie beyond certain 
limits. 

It may be reasonably assumed that if a great many samples 
were drawn from a population and means of measurements of 
some kind were calculated from the samples, those means would 
make a normal distribution. Suppose we have given to 101 high- 
school pupils a general information test and have obtained a mean 
of 93 and a standard deviation of 20. The standard error of this 
mean [formula (64o)] would be 20/-\/"l00, which equals 2. If we 
were to repeat the test with many other groups of high-school 
pupils, the means would fluctuate in such manner a.4 is indicated 
in the accompanying bell-shaped curve. These means would 
gather around the true moan at the center of the distribution. 
What this true mean is wo do not know. Most writ(!i'H on 
elementary statistics assume that it is the obtained mean that 
lies at the center of the distribution. This is a wholly unwar- 
ranted assumption and an unnecessary one. We shall not fall 

into that blunder, although to do so 
would make our explanation sim- 
pler. Let us place our obtained 
mean off somewhere from the cen- 
ter of the distribution, say at OM. 
It is possible that the true mean 
may lie, say, as high as 96, which 
is one vu above 93. For, if the 
true moan were 96, we would still get a mean as low as 93 
sometimes; in the whole distribution of samples, means of 93 
or less would be obtained in all that proportion of the oases 
lying in the tail of the normal distribution below point OM. 
The ordinate OM lies Iff away from the mean, and reference to 
our table of integrals of the normal curve in the Appendix will 
show that, when au/ff* «= 1, the percentage of cases between 
the mean and the ordinate is 34.13, and hence the percentage 
in the tail is (60 -- 34.13) =* 16,87.^ Hence we would be among 
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15.87 per cent of the cases if our sample mean lay at one standard 
error below the true mean. But, if this is so, something has 
happened to us that would happen only 15.87 times out of 100. 
The odds against that are about 5.3 to 1 (34.13 + 50 divided by 
15.87). Hence we infer that the true mean probably does not 
lie as far above ours as we hypothetically assumed; the chances 
are only 15.87 in 100 that it does. In a similar manner we can 
test the probability of our having obtained the mean we did if 
the true mean lay as low as 91, which is one standard error below 
ours. The chances that we would have obtained our mean of 
93, if the true mean is only 91, are again only 15.87 in 100, as the 
proportion above ordinate O'M' indicates; hence the chances 
are 15.87 in 100 that the true mean does lie as low as 91. Putting 
these cases together, we may say that the chances are 15.87 
in 100 that the true mean lies at 91 or below and also 15.87 in 100 
that it lies at 95 or above; but that, conversely, the chances are 
68.26 in 100 (about 2 to 1) that the true mean lies between 91 
and 95. We may make similar hypotheses about our chances 
of having obtained the mean we did if it lies two vk’s above or 
two below the true mean and may find that the chances are 
95.44 in 100 that the true mean lies between plus and minus two 
standard errors of the obtained one, viz., between 97 and 89. 
Or we can make our limits throe or four standard errors, or 
fractional parts of these measures. Or we can make computa- 
tions of the probability that the true mean does not lie beyond a 
standard errors above or beyond b standard errors below the 
obtained one. We can also make these interpretations in terms 
of P.E.’s instead of <r’s, either by employing tables made up in 
terms of P.E. units or by remembering that P.E. equals 0.6745 <j- 
and working with tables in terms of <r accordingly. The interpre- 
tation in terms of P.E. is particularly simple because the chances 
are 50-50, or the odds one to one, that the true mean does not 
lie more than one P.E. above or below the obtained one. This 
same type of interpretation holds for all other measures of 
reliability. 


FrotrciAL Limits 

The above discussion of the limits between which the true 
mean or other statistic (called the parameter or the populcction 
paramder) may, with a given degree of confidence, be expected 
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to fall was conducted in quite untcchnical terms. In recent years 
this principle has been dealt with in a much more straightforward 
but highly technical manner by R. A. Fisher and others under the 
term fiducial limits. But, because of the desirability of covering 
the case of small samples as well as large samples, the standard 
of confidence is put in terms of probability of correctness rather 
than in terms of abscissa values, as wc put it above. Wo shall 
later see that the proportion of the area of ihe distribution of i’s 
(standard-error units) lying between certain t values is some- 
what dependent upon the size of the samples, hence must, be put 
in terms of both t and n; and this same thing is, consequently, 
true of the probability that the parameter lies b(itwe(‘n t,he values 
corresponding to these points. The selection of the fiducial 
(confidence) limits is, of course, arbitrary, but 95 per cent is 
customarily taken as an acceptable fiducial probability for 
satisfactory significance and 99 per cent for high significance. 
The former standard means that 95 per cent of f,he estimab's of 
the parameter made from an infinite supply of sainijlas lie 
between ordinates OM and O'M' in our figur(^, page 136, while 
6 per cent (2^- in (;ach tail) lie outside. If f,hfi sampler is large 
so that the distribution may be considered normal, an inspection 
of our table of the normal curve function on page 484 will show 
that the t corresponding to 0.025 in the tail is plus or minus 1.96. 
In the latter case, with 0.005 in the tail, the t is 2.5758. So in our 
example with a largo population (100), a mean of 93, and a stand- 
ard error of the mean of 2, the chances are 95 in 100 that the 
true mean lies between 93 ± (2) (1.96), or Ix'twecn 89.08 and 
96.92. Correspondingly, the chances are 99 in 100 that the true 
mean lies between 93 ± (2)(2.5758), or between 87.85 and 98.16. 
If the sample had been small, say 12 individuals, wo would go 
to Fisher’s t table, page 173, enter it with n-JV — l — ll, and 
find along that row in the column headed .05 the t «“ 2.201, 
and in the column headed 0.01 the t » 3.106. Then the cor- 
responding fiducial limits for a fiducial probability of 96 per 
cent would be 93 ± (2) (2.201) * 93 ± 4.402; and for a 99 per 
cent fiducial probability, 93 ± (2)(3.106). Thus the “confidence 
belt” would esrtend between 88.598 said 97,402 in the former case 
and between 86,788 and 99.212 in the latter. We could claim 
that the true mean would be found somewhere within the former 
range with the chances 95 in 100 that our claim would be correct 
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or that it would fall somewhere within the latter range with the 
chances 99 in 100 that the claim would be correct. 

This interpretation has been applied to means. A correspond- 
ing interpretation is applicable to variability measures, to r’s, 
to proportions, or to any other statistics where w^’e can know the 
form of the distribution of the estimates of the parameter made 
from samples. It is also applicable to differences between 
statistics, or to sums of statistics. 

It would be beyond the scope of this book to go into a technical 
treatment of this issue. The reader who is interested may 
pursue it in the monographic literature. He should begin with 
Fisher^s initial article, Inverse Probability,” Proceedings of the 
Cambridge Philosophical Society, Vol. 26, pages 528 to 535 (1930), 
which he will not find very difficult. Another general expository 
article is by S. S. Wilks, ‘^Fiducial Distributions in Fiducial 
Inference,” Annals of Mathematical Statisticsj Vol. 9, pages 
272 to 280 (1938). For a technical discussion of the case of 
large samples see Wilks, Shortest Average Confidence Intervals 
from Large Samples,” Annals of Mathematical Statistics, Vol. 9, 
pages 166 to 175 (1938); and for a thorough discussion of the 
general case, see J. Neyman, ‘^Outline of a Theory of Statistical 
Estimation Based on the Classical Theory of Probability,” 
Transactions of the Royal Society of London, Philosophical, Series 
A, Vol 236, pages 333 to 380 (1937). 

THE STANDARD ERROR OF A STANDARD DEVIATION 
We shall develop first a formula for the standard error of 
s^, an estimate of the population variance^ and then pass to 
the standard error of s and of or. By definition of a standard 
deviation 

(r2 « — 

n 

when -the values are taken as deviations from the mean of the 
sample, the summation is through the sample and n is the num- 
ber of individuals in the sample. If we conceive the x^b as 
deviations from the mean of the whole population, we shall have 
if the summation runs through the sample,^ or the theoretic 

^ Irwin proves that -- mY/n* gives an unbiased estimate of the 
population variance, where is a variable in sample r and m is the grand 
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cal standard deviation of the population, if the summation covers 
the whole population. 

Remember that is the mean of all the s^’s. Lot the devia- 
tions of the several s-’s from this c® be represented by dj, d-j, dg, 
etc. Then di = sj — cf“; and squaring, d? = (sf — But 
s\ — ^x\/n, where the summation is over the sample. Sub- 
stituting accordingly, 


dl 






n ^ n 




^2) 


n 


+ 


+ 


{ai - ofS) 


In order to carry along less cumbersome notation, we shall 
represent the quantities in parentheses by Wa, etc. Thou 

^2 _ (<Ja + COb + + * " * + 

1 /VI 2 


We shall have similar expressions for ds, dj, etc., involving 
each of the other samples of the whole set of S. If we .sum for 
all the.se squared deviations and divide by S, wo shall have 


Sd® _ -h 2SSW.-0J,-). 


S 


Sn^ 


; or SnVJ. = S(2w® + 222«i«;) 


But this is precisely similar in form to Eq. (A) in our develop- 
ment of the formula for the standard error of a mean. It will 
simplify in precisely the same manner, so that wo arrive at an 
equation parallel to Eq. (D), 


SSw*/i n-l\ 
Nn 


where N is the whole population from which the samiiles are 
drawn. Substituting for w the value for which wo lot it stand 
and for (» — 1)/ (JV — 1) p in the same sons<! as used in our 
development of the formula for the sigma of a mean, 




Nn 



N 



mean. That is, the sum of the squared deviations from the population 
mean divided by the number of items in the sample gives <*. J. Roy. 
Statiatical Soc., Yol. 94, p. 286. 
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Multiplying numerator and denominator of the first quantity 
by remembering that 2x^/N is 9^ (since the x^’b have been 
summed for the whole population with no duplicates) and that, 
in summing, 9^ was taken N times so that would equal Nc*, we 
have 

But 'Zx^/Na^ is Therefore o-J* = (l/n)(j32ff^ — cr^)(l — p). 
In a normal distribution jSa equals 3. We may safely assume 
normality here, since the distribution to which the refers is not 
that of one of the samples but that of the very large total popula- 
tion, N, Substituting 3 for ^ 2 , we have 

(F) cr?, = 1 (3?^ - 9^){1 P) 


The p is zero for random samples from an infinite universe. So, 


2 — — -2 (Standard error oi 

^ 5 ^ of the population 


of estimates 
variance) / 


Since, whatever the nature of the scores represented by x 
and whatever the multiplier represented by a, aax = acr* and 


and since 


(see page 77) and since <r^ = 

S = O’, 

^ . (rLzj)' . ^ ( » ) 

\n/ \ n / n \ n / n \n — 1/ 

2 [2 
= — <r,. = <r^ . / - 

n \n 


(Standard error of the fan \ 

sample variance) (.0/®) 


Note that d means the average sample value, not the population 
value. Ordinarily we must substitute for it the a of the sample 
we have in hand. For the 9 of formula (67) we must substitute 
the s computed from the sample in hand by dividing the sum of 
squares by (n — 1) instead of by n, as explained on page 70. 

The above paragraphs gave us the standard errors of and 
of We need also the standard errors of s and of <r. These do 
not come through quite so smoothly; in any simple form our 
formulas must be approximations.^ 

* T. Kondo presents (Biometrika, VoL 22, pp. 36-64) a thorough study of 
the sampling variance of <r, with different assumptions and degrees of 
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Let us set up an identity, then put it through certain algebraic 
transformations, s, shall represent the estimate of the popula- 
tion variability made from any one sample. 

Sf = -I- S? - 


Expanding the expretssion on the right by the binomial theorcun, 


Si = 


1 + 


1 _ 1 AI_zJ!Y 

2 V / sV &* / 


+ 


16 




Since (s| —9^)ls^ has usually a value leiss ihan 1, the tcrm.s 
beyond the second will be small in value compared with the first 
two. We may, therefore, take, approximately, 



This expression contains a multiple of s? and a constant addend. 
Since the s’s arc regarded as variates of which we are to estimate 
the standai’d deviation, wo have a situation similar to aax-^b — 
and <rl^ - (see page 77). Applying this principle. 


4?» 




Substituting for cr*. the value given in formula (67), 

(Standard error of «) (676) 

Since a * sv^n^-^llAb the standard error of v will be that 


approximation. The outcomes are complicated formulas which differ 
somewhat in the values they give according to the assumptions. Fisher 
and some others give formula (67) with (iV* - 1) instead (AN u the denom^ 
nator. But we cannot find any approximation in our derivation which if 
corrected would lead to this {N — 1)* If that denominator is (iV* — 1), the 
numerator in our formulas would be the population value instead of the 
average sample value* 
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multiple of the standard error of s, and <t\ will be the square of 
that multiple of o-J. Therefore, for random samples, 


2 ^ 1 ^ 

^ ^ n 2n "" 2n’ ”” 

Note that ^ is the average standard deviation from samples, not er. 

It will be where we are comparing variabilities in small samples 
of unequal sizes that we shall need Ca instead of o-<r, because when 
samples are very small and unequal in size, or at least when one 
of them is small, the sample standard deviations are likely to 
give a false impression of the true relation, as explained on 
pages 69 to 71, 

We have been considering the special case of random samples. 
In the more general case, involved in Eq. {F) above, the factor 
(1 — p) is included. That belongs here as well. The p has here 
the same force as in our discussion on the standard error of the 
mean. It is the percentage our sample is of the whole population, 
hence also the percentage of overlapping from sample to sample. 
If the successive samples are correlated with an initial array 
with which they are matched, the p represents the coefficient 
of correlation between this array and each of the samples, so 
that we have the following formulas for the standard error of a 
standard deviation: 


cr<r — 


<r<r = 




VW 






(Standard error of a standard devia- 
-^1 _ tion when samples are matched with 
^ a true criterion, as where we take 

repeated tests of the same group) 
(Standard error of a standard devia- 
tion when samples are matched on 
a fallible criterion, as where we 
measure the moral judgment ojf 
pupils of the same average educa- 
tional age) 

(Standard error of a standard deviation in case 
of random samples from an unrestricted popu- 
lation, where consequently no correlation is 
present) 


( 68 ) 

(68a) 

( 686 ) 


STANDARD ERROR OF A FREQUENCY AND OF A PROPORTION 
In our chapter on the normal curve it will be shown (page 298) 
that the standard deviation of a point binomial is -s/npq. In 
this formula, p is the probability of “success" in the case of 
any one “event,” and g is the probability of “failure” while 
n is the number of “events” and t^efore the exponent of the 
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point binomial. To speak concretely, if n is the number of 
pennies tossed, p the probability of a “head” (of success) in 
each penny, and q the probability of a tail (of failure), then 
(p + O')" gives the distribution of successes and -v/ npg is the 
standard deviaiion of the distribution of the successes or of the 
failures. With ordinary pennies p = 2 = but with weighted 
coins p and q might have different values; but always p + 2 
would be 1. 

Now it makes no difference to the nature of the distribution 
or to its standard deviation whether the n pennic.s are i,c».sHed at 
one throw or whct.hcr they arc tossed one at a time and con.sidorod 
in sets of n each. It is thi.s latter sort of case w'O would have if wo 
entered one after another 100 homes as a sample to determine 
how many of them have telephones, if wo measured as a .sample 
100 children to ascertain what proportion have intelligence 
quotients between 40 and 70, or if wo inve.stigatod proportions 
in any sort of sample at all. If we think of ourselves as drawing 
such samples one after another, wo have pn^cisely fho same 
sort of situation as if wo toss a set of n coins repeatedly whether 
all at once or one at a time. Hence, if we know the probability 
of success in the case of particular individuals, wc can foretell 
what standard deviation to expect if wo were to continue drawing 
until we had a large dist.ribution of samples; it would bo -s/w^i 
where the n is the number constituting a set, which is the sort 
of application wo are in the habit of calling iha population of 
our sample. Thus to draw sample after sample is the same 
thing in principle aa tossing a set of n coins many times in succxis- 
sion. In such application we seldom actually draw a largo 
number of samples and compute the actual standard deviation 
but, instead, infer it from what wo know of the properties of tho 
distribution that generalizes the point binomial; hence wo speak 
of the standard error of sampling rather than of the standard 
deviation of a binomial distribution. 

But how can we know tho p and the g? We assume thorn to 
be the ones indicated by the behavior of our sample in hand. 
That is, we take it that we have in hand the most probable com- 
bination of successes and failures and use this combination to 
define tho p and the g; if 26 per cent of the homes in our sample 
have telephones and 76 per cent do not, we assume for purpeaes 
of our formula that p « i and g “ i. This assumption is a 
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precarious one, since we may have happened upon a sample that 
involves a marked deviation from the modal one; but we can do 
no better than to accept it on faith as representative. 

Success may be defined in any way that fits our purpose: 
having a telephone, brushing the teeth at least once a day, 
falling between score 45 and score 64 on a certain geography 
test, standing above score 90 on an intelligence test, or whatever 
else we please. We can, thus, very appropriately define success 
as coming within any category in a distribution and failure as 
lying outside such category; and hence the standard error of a 
frequency in any category is given by the formula 

— » (Standard error of a frequency in any /oan 

v/ V category in a binomial distribution) 

Here N is the total population of the sample (including both the 
cases within and those without the category under consideration), 
p is the probability of being in the category as indicated by the 
proportion that is in it in the sample, and q equals (1 — p). 

If we divide the frequency by the total number, we shall, of 
course, have the proportion of individuals in the category. 

We have already shown (page 77) that v* = ^ o-,. Applying 

this principle, but remembering that we must square our divisor 
when we place it under the radical sign, we have 

_ l-^PQ _ Im (Standard error of 

'V A* \ iV a proportion) i.*”) 


THE STANDARD ERROR OF A PERCENTILE 
Let P be the true point designating a percentile in which 
we are interested, i.e., the point 
at which this percentile would 
be located in the average of a 
very large number of samples 
from a population. In a partic- 
ular sample the obtained per- 
centile might go up to Ps, which , ^ 5 ' ' ' ’ * 

is a distance A? above P, or 

down to Pi, a distance of Af below. If we take the figure PPjPaP 
to be for practical purposes a rectangle and denote its height by y, 
its area (f) would be yAp, We would have, therefore, yAp = f, 
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or i\p = f/y. Squaring, A| = (P/y^)- Summing for all the 
samples and dividing by the number of samples, 


EA| _ SjP/S 
S ~ 


> or cr} 


4 =2 


But is the same as the v* of the area of the tail of the dis- 
tribution, p; for the tail is bounded by the line PP so that the 
positive and negative increments of the tail are identical with 
those that constitute /. We have just shown that the standard 
error of a frequency, and hence of the tail p and consequently 
of /, is 

Cf = ■\/Npq, whence a) = Npq 

where N is the total population of the sample, p is the proportion 
of cases in the category under consideration (here the one tail), 
and q is the proportion of cases outside the category (in this 
case the other tail). 

Substituting this value in the equation above, wo have 


y^ 


(One form of the standard m . \ 
error of a poroentilc) / 


This is the formula we need, but wo desire a Himpl(>r valiu* 
for the j/®. The y is the ordinate of a normal distribution at 
the position P. In our treatment of the normal curve wo show 
that 


V “ 


_N . 


Ai 


We may separate this into two factors as follows: 



The part in parentheses is z for which numerical equivalents 
are given in Table XLIV in the Appendix, since z is defined as 
the ordinate of a normal distribution in which JV »■ 1. There- 
fore 


V 
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Substituting this value of y* in formula (71), and simplifying 
the formula, we have 

s _ _ irWpq __ (T^pq 

~ zm 

wherefore 




z\N 


(Standard error of a percentile 
in a normal distribution) 


(72) 


The resultant standard error of the percentile is in the same 
units as the <r; if the cr is put in terms of score points the standard 
error is in terms of score points. 

As an example, take a distribution of 100 cases with a standard 
deviation of 12, and find the standard error of the 20th percentile. 
Looking in Table XLIII, we find that, when p = .20, z = 0.2800. 
Substituting the known values in our formula we have 


. jti ^ ri6 _ 1 71 

0.280 V 100 0.280 A/ 100“ 

Certain percentiles are employed so frequently that it will 
be worth while to determine here their standard errors. One 
of these is the median. The median is the 50th percentile. 
In order to determine its standard error we need only make both 
p and q equal .50, determine the z from our table at the point 
where p = .50 (which is 0.3989), and solve for a-ua^- 


<r /(.50)(.60) 
0.3989 >/ N 


1.253 


(X 


(Standard error of a median) 


(73) 


Since, when working with medians instead of means, we usually 
have point measures in hand rather than moment measures, 
this formula will customarily be more convenient when put in 
terms of probable error and of the quartile deviation of the dis- 
tribution. In a normal distribution Q is 0.6746 times <y, and 
similarly P.E. is 0.6745 times the standard error. Therefore, 
multiplying both sides of our equation by 0.6745 and substituting 
the equivalent symbols, we have 


P.E.MdB 


1.253Q 

Vn 


(Probable error of a median) (73a) 
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The standard error of a quarter point is found by a similar 
procedure as follows: 


(T I (.75) (.25) 1.3626<r 2Q , , . 

(Standard error of a quarter point) (74) 
Multiplying both aides of the equation by 0.6745, as above: 


P.E.Q, or P.E.<„ = 

■s/N 

(Probable error of a 
quarter point) 

(74a) 

By the same procedure 



P.E.Pio or P.E.i>,o = — 7 ^ 
-VN 

(Probable error of the 
first or ninth docile) 

(746) 


THE STANDARD ERROR OF INTERPOINT RANGES 
We often wish to state our variabilities in terms of the range 
between two points, as the interquartile range or the range 
between the first and the ninth decile points which Kelley has 
called D. We can compute a standard error for such ranges as 
follows, considering our statistics to bo in the form of deviations 
from the means of the whole sots of these statistics. We shall 
let Pi and P* represent the two percentile points between which 
we are considering the range. 

, S(P2-Pi)* 2P| , SP? 22;PjPi 

4.-,. -s T + -S-- — S— 

If we recognize the first term as o-l^ and the second as <r| and 
multiply the third by we shall have 

2 2.2 0 SP 2 P 1 

== ffp, + - 2 

This last term contains an expression for Tptpu When we sub- 
stitute this wo shall have 

(General formula for the 

vl-p, = <fp, + ffp, — 2rp,Pi(rpitTPi standard error of inter- (76) 
* percentile ranges) 

We encounter here the need for a formula for the r between 
percentiles. The following development of such formula follows 
in the main the development by Yule. 
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Let Pp^ and Pj,, be two percentile points, the former marking 
off a tail of pi in the distribution and the latter a tail of pa. If 
we make here the same assumption that we did in connection with 
the development of a formula for the standard error of the 
percentile (see page 145), viz. that through the small distance 
through which the percentile fluctuates from sample to sample 
the curve may be considered 
substantially flat, the deviations 
in the lower percentile are di- 
rectly proportional to those of 
the area of the tail of the distri- 
bution (pi), while those of the 
upper percentile are proportional 
to p 2 but of opposite sign. We 
may, therefore, take the correlation between the percentiles to be 
the same numerically as that between the areas pi and p 2 but of 
opposite sign. Our problem, then, is to get a value for the r 
between the proportions pi and p 2 . 

If there is a deficiency of observations below the lower per- 
centile, so that in the sample in question the area below Pp^ 
differs from the true proportion by Si, that deficiency may be 
expected to be offset by a surplus above apportioned to the other 
categories in proportion to their respective sizes. Thus p 2 will 
have a positive increment 52 of such size that 



where gi is (1 — pi) and is, therefore, the whole area within 
which the 5i increment is to be apportioned. Thus —(pi/qi) is 
the regression coefiicient of Ss on 5i. The coefficient of correla- 
tion is (see page 111) the regression coefficient multiplied by 
the ratio of the standard deviations of the two series. Therefore 

r =r. P 2 _ VTviqi/N) 

¥i *’>*’« qi (Tp, ffi V iptQi/N) 

(f between proportions in 
cella in the same distri- / 76 'i 
bution) ^ ^ 

Since, as said above, the r between percentiles is the same 
numerically as that between the tails marked off by them but 
of opposite sign, 


Vyjpigi ^ 
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— ElEl (CoeHicient of correlation between per- 

centiles in the same distribution) vO 

Ordinarily wcj shall be (*.oncerncd only with ranges between 
symmetrically placed points, i.e,, between points equally 
distant from thc'ir respective ends of the distribution. In this 
case Pi = p 2 and f/i = so that r = p/q. Fudhermore, in this 
case the standard <‘rrors of the two percentiles are ecpial, so that 


or cTjPj 


E IF^ 

z\IN' 


VVe may then simplify our formula for 


the standard error of a range as follows: 






+ 4. 


0-;. 


.V2\r 


■ — 2<Tp„0 ~ 

( 8 tnndjird error of tln^ nin|tt:(‘ 

7*1, r. ) l>(‘tw(Mm synunetricnliy 
placocl percentiles) 


(78) 


With this formula let us find tli(^ s(.andard error of Q, flie s(!ini- 
intorquartilo range, often calh'd the qwirtilc deviation. (Notice 
that Q is very different from C^i.) Q is half tin* range l)et\v<‘en 
Qi and Q^, that is, ludf the i-ange hetwiMui IJk' 2r>i.h and the 7oth 
percentiles. Sigma of the 25th and also of this 75th pcu'ctuitih^ 

is ’’ hetwec'U these t.we ))oreentilc's is .25/. 76, 

which equals .333. From our table's in thi^ ,\ppeiuli.'£ z i.s found 
to be 0.3178. Substituting these values, we g('t 






5 )(. 25 ) 
N ■“ 


V2(l - .3333) 


lh734(r 


Since Q is half of the intorcpiartile, range its standard error will 
be half as large. Tluirefort', dividing by 2, we g('t 


(Tq 


P.E.<i 


0 . 7867 cr l.lfibQ (Stiiiulard error aud probable 
— • = 3 = of Q, the Bomi-intar- 

V iv V iv quartilc range) 

OM06cr 078659 


(79) 


D was defined above as the range between the 1st and the 9th 
decile points, t.e,, between the 10th and the 90th percentiles. 



RELIABILITY OF STATISTICS 


151 


The substitutions required in the formula for getting its standard 
error are as follows: 


.1755VJV 


. 1111 ) = 


2.27920- 

^/N 


3.380 

■s/N 


= 1 - 5 ^ = 2.280 

■\/N VN 


(Probable error of the 10th /gQ'\ 
to 90th percentile range) ^ 


We shall give without proof the value shown by Kelley for 
the standard error of an average deviation: 


0.6<r ^ O.^Q 

Vn VM 

P.E.A.D. 


(Standard and probable errors 
of the average deviation) 

Q.4066cr ^ 0^ 

Vn 


(81) 


If wo put the standard error of each of the measures of vari- 
ability in terms of the magnitude of the variability measure 
itself, we can get a clear idea as to which measure is most stable 
and therefore most dovsirable when other considerations are equal. 
In doing this we shall need to know the equivalents between <r 
and (^ach of the other measures of variability. Q equals, of 
course, 0.6745cr. On page 81 it is shown that A.D., in a normal 
distribution, equals 0.7979a-. The relation between D and cr 
is found as follows. By referring to Table XLIII in the Appendix 
we find that when q ~ ,10, = 1.2816. The are in terms of 

a'^s of a normal distribution of unit area and unit standard devi- 
ation. Thus from the 10th percentile to the mean is 1 . 28160 *. 
From the 10th percentile to the 90th is twice as far. Thus D, 
the whole range from the 10th to the 90th percentile, is 2.5632o-. 
Therefore, replacing <r's by their eq\uvalents in other statistics, 
we have 


0.707<r 


cr<r = 


Vn 


0.6028<r 

_ 0.756 A.D. 

<rA.D. = 

Vn 

Vn 


2.279(r 

0.889D 

<rn — 

Vn " 

“ Vn 


0.7867O- 

^ 1.166Q 

(TQ =5 

Vn 

"Vn 
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It is thus shown that the standard deviation is the most reliable 
of the customarily employed variability measures, the average 
deviation next, then D and last of all Q. Of course, all these 
computations turn upon the assumption of a normal distribution. 
In practice with small distributions these relations may not 
hold in precisely the same way. 


THE STANDARD ERROR OF A COEFFICIENT OF CORRELATION 


In the lithoprinted edition of this book wo gave a derivation 
of the formula for the st.andard error of r. But the derivation 
was rather lengthy; consequently, limitation of space compels 
us to omit it from this edition and to rcifer to the earlier edition 
those readers who are interested in following the proof. The 
formvila derived there is the following customary one: 


_ 1 — r* 

“ Vn 


P.E.r 


= 0.6745 


1 - 


(Standard error of r) (82) 
(The probable error of r) (82a) 


The derivation involves the following assumptions: recti- 
linearity of regression in both arrays; homosccdasticity in both 
arrays; and mesokurtosis = 3) in the sample in both arrays. 
These assumptions are rather hazardous, and the distortion is 
made far worse by the fac.t that the distril)ution of r’s from 
random samples is highly skew for arithmetically large r’s. 
It is however satisfactory for largo samples and for small or 
moderate sized r’s. 

Soper^ has shown that, by avoiding certain assumptions and 
approximations in the above typo of development, a somewhat 
better approximation can bo made to the standard error of a 
coefficient of correlation as follows; 


(Tt — 


JL- P" 

ViV"- 1 


1 + 

. 4(i\r _ i)j 


(Bocond approxima- . 
tion to tho stand- (83) 
ard error of r) 


where p is the true correlation (that from the whole population). 
Note that this p has nothing to do with ranks correlation, for 
which it is customary to employ the same symbol. In practice 


* SoPBB, H. B., ''On the Probable Error of a Coefficient of Correlation to 
a Second Approximation,'^ Biometriha^ Vol. 9, pp, 91-115 (1913). 
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we would not know p and would need either to estimate it by the 
rather complicated formula given below or substitute r for it. 
We show below that, in samples of reasonable size, r is, on the 
average, a close approximation to p. 

But what we most often need in practice is not the standard 
error of the r computed from our sample but the standard error 
of r for samples of the same size when the true r is zero. For 
most often we wish to know whether we could reasonably expect 
to have obtained as large r as we did if the true r is zero. The 
formula* for the standard error when the true f is zero follows 
readily from the formula quoted above from Soper; it is 

^ (Standard error of r where 

** 's/N — 1 ^ 

In this case the distribution of random samples is symmetrical 
about zero and may be regarded as normal except for very small 
samples. This formula should be used much more than is now 
the case. It is always the pertinent one when what we wish to 
show is that our obtained r differs reliably from zero. 

r’s from Small Samples, — ^There is always a slight bias in r 
computed from a sample less than the whole population. Fisher^ 
gives the relation between an r from a sample and the ^'most 
likely'' population value as follows: 


^ = r — 


r(l - r , 
2(N - 1) L" 


1 _ M 1 (Most likely ijop- 

-T— ^ ulation equiva- (85) 

4(i\r — 1) J lent of an r) 


This correction would be very small with more than 25 pairs 
of observations and wholly negligible with N’s of 50 or more. 
It always reduces slightly the arithmetic value of r, except when 
r = ±L00 or when r = 0, at which points ^ = r. But the 
correction is always far less than the probable error. 

It is also true that the distribution of correlation coefficients 
in random samples around a true r is not normal. Of course, 
that distribution is skew for samples of all sizes as p departs from 
zero; but in addition the distribution of t (the ratio of r to its 
standard error estimated from a sample) is leptokurtic, so that 
the use of the normal curve values gives somewhat erroneous 

> Fishbb, R. a., “On the Probable Error of a Coefficient of Correlation 
Deduced from a Small Sample,” Metron, Vol. 1, No. 4, p. 9 (1921). 
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interpretations of the reliability, especially in small samples. 
According to Fisher, t obtained by (be following oxpr(\ssion is 
distributed in the same manner as Student’s ratio on the hypoth- 
esis that the true r is zero: 

_ jr^{N — 2) (Student’s i for (lie reliability of r 

_ fS~ wiu'n cstiinatcd from tlie sample) '■ 

Fisher does not offer the denominator in (lie middle expression 
above as a formula for the standard error of r; he merely shows 
that the best estimate (bat can be made from a single sample 
of the probability of obtaining by (thance an r of the size of 
the one in hand (or larger) if the. true correlation is zero is given 
by the t determined by formula (86) when used wi(h Student’s 
distribution. The (able, which wo give on pages 488 to 492, is 
to be entered wi(,h n — (N — 2), and 'Table XLVI must bo 
used (o suppltmumt ''J''able XLV if precise probabili(.ies an* 
wanted and n ('\c('eds 20. Bui. for retusomibly Itirge w’s (be itor- 
mal curve tabh's give- good t'uough es(.ima(.es ('xc(‘pt for V(!ry high 
odds (very low probabilitiris). On the, average, formula (84) will 
give practically tin* same vahuis as formula (86) exe.ept wlutre N 
is as small as 25 or less, and the former is much easier l.o use since 
it is independent of r and (he reliability of a whole column of r’s 
from the same population can b(^ indicatcid oikh! for all since, only 
the N is involved. 

Fisher mak(fs much of handling small sampkvs, hence his 
emphasis on such formulas as (86) which differ in outcomci 
appreciably from the classical ones only in the case ol small 
samples. Ho characteristically canies the computation of an 
r to four decimal places, even when computed from 10 to 20 
pairs of observations and when the standard error is of the order 
of .20. Then, because ho employs formula (86) instead of (82) 
for the ^, he speaks of his method as “exact.” But the research 
worker must not be misled into thinking that any such legerde- 
main permits him to calculate coefficients of correlation from 10 
or 20 pairs of observations and have meaningful results just 
because he employs some trick “correction” formula. No sta- 
tistic is more dependable than the observations upon which it is 
based, for any correction formula mak^ the obtained statistic 
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its starting point. Correlations from 10 pairs of observations 
are practically useless regardless of any “corrections^ formulas, 
unless they are from extremely stable variates such as means of 
large classes. 


TRANSFORMING r INTO J 

In view of the fact that the distribution of r is limited to ± 1, 
random samples for a given p become highly skew at the two ends. 
Furthermore, it becomes harder and harder to raise an r through 
successive equal units as perfect correlation is approached, so 
that a difference of (say) .10 means far more near the upper or 
lower limit than it means near zero. To remedy this, Fisher has 
proposed that, for certain computational and comparison pur- 
poses, we use instead of r the hyperbolic arctangent of r, which 
he calls z but which, following Tippett, we shall designate 
because it is not exactly the same as the z employed for testing 
significance in analysis of variance. 


tanh“^ r ^ z' = Mlog« (1 + 

- log, (1 - r)] 


(Fisher’s formula for 
+ranslating r into s) 


= [logio (1 4- r) - logio (1 - r)\ 


(87) 


s' can take values from zero to infinity and can take either the 
plus or the minus sign. Fisher derives^ for the distribution of 
random samples of z' the following measures of skewness and of 
kurtosis: 


“ (F-" ~ b) + ■ ■ ■ 

O _ O . 32 - 3p^ , 128 + 112p“ - 57p‘ - 9p« 

+ 16(JV -1) ^ 32(F - 1)2 

Thus / 3 i, although depending somewhat upon p, is nearly equal 
to zero so that the distribution is nearly symmetrical; and 182, 
while also somewhat dependent upon p, is nearly equal to 3 . 
Because for a normal distribution 81 equals 0 and 82 equals 3 , 
Fisher claims that the distribution of random samples of 2' 
is “nearly normal.” In his Stoiietical Methods for Eesearch 

p. 14. 
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Workers, Fisher gives for the standard error of z' 


1 


(Approximate formula for tho 
standard error of -j') 


( 88 ) 


which is independent of s' and consequently of r. But that is 
only an approximation. The more complete formula is* 

1 r. , 4-p* 

' ' ' ] ( 88 «) 

Thus the standard error of s' is somewhat dependent upon the 
s', since s' is a function of p. E. S. Pearson and his asso(3iate3 
have made several empirical studies of the distribution of s' 
and its standard deviation^ and find that the full formula agrees 
rather closely with the actual distribution and that the approxi- 
mate formula does moderately well. 

The mean departure of the average s' from the true s' is not 
zero; the s' has a slight bias as follows: 

^ - t' = [l + 8(F^ ■ ■ ■ ] 


In precise work with s' this requires that a small correction bo 

made to the obtained s', which is approximately 2(]v'^— “i)’ 

and which must bo subtracted arithmetically from the z' obtained 
by formula (87). 

There are some advantages to the use of s'. 

1. The fact that s's in random samples are distributed almost 
normally along the whole range makes the interpretation of the 
standard error more meaningful and legitimate. Regardless of 
the size of the sample, the interpretation may bo made in terms 
of the normal curve. 

2. Unit increments of s' have nearly the same meaning (in 
terms of diflBioulty of attaining them) all along their range, while 


1 md., pp. 13-14. 

* Pbabson, Boon 8., “Further Experiments on the Sampling Diatribu- 
tion of the Correlation CoelHoient,” /. j4»aer. BtaUttiedl Anoe., Vol. 27, 
pp. 121-128; see also Biomtriha, Vol. 21, pp. 257/. 
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r’s do not. This fact makes adding, subtracting, or averaging 
more legitimate processes than are like processes with r's. 

3. If one is insistent upon showing how sample r’s would 
spread at the level of his obtained r rather than around a true r 
of zero, the only really correct way of showing it is by translating 
his r to and interpreting the z* in terms of the cr/. For the 
distribution of r’s around any other point than zero is neither 
normal nor symmetrical. 

On the other hand z' has limitations of which cognizance must 
be taken. 

1. Its reliability formulas (when in usable form) are approxi- 
mations, just as are those of r. 

2. z' is only an intermediate statistic; the final result must 
be in terms of r. For z' has only an artificial meaning while r 
has a straightforward and practical meaning: viz.^ the slope of 
the best-fitting line when the variabilities have been equalized. 

3. The advantage from the standpoint of standard error is 
academic rather than practical. The main situation in which 
we are concerned about the standard error is when we wish to 
know whether the r we have in hand might have arisen by chance 
when the true r is zero. But samples of r when p is zero are 
distributed as symmetrically as z' is, and nearly as normally, 
and the formula for the standard error is also independent of r 
[formula (84)]. Since r at this point has all the advantages of z', 
the awkwardness of the transformation may be avoided. 

4. It is legitimate to add or to subtract z"s only when we can 
assume that they are estimates from the same population. It 
would not do, for example, to average z'^s for the correlation 
between intelligence tests and academic achievement when the 
intelligence was measured by different tests and on somewhat 
different types of students. When needing a central tendency 
for a number of r^s it would be much better to take the median, 
and the median z' would correspond exactly to the median r, so 
that nothing whatever would be gained by the transmutation. 

6. If we add or subtract z'^s in correlated samples and test 
the significance of the sum or the difference, we shall lose accuracy 
by reason of not knowing the tail of the formula involving correla- 
tion (see pages 160 to 162). For the r between z''s is not known. 
The loss from this cause might well be greater than any gain 
from using z' instead of r. 
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ADDITIONAL RELIABILITY FORMULAS 

For the standard error of pi or 182 , soe H. L. Reitz, Handbook of 
Mathematical Statistics, page 96, or Karl Pearson, Tables for 
Statisticians and Biometricians, Tables 37 and 38. For many 
additional standard-error formulas, see Kurtz and Dunlap, 
Handbook of Statistical Nomographs, Tables, and Formulas, pages 
103 to 140. 


Exercises 

1. Find the P.E. of the mean in Table I, page 43, and in Tabl<^ 11, page 
45. Interpret those statistics. 

2. Find the standard error of the medians for these same two distributions, 
and compare them with the standard errors of the means, 

3. Find the value of the 10th percentile in Table I, and compute its 
standard error. 

4. The norm for the seventh grade in a certain arithmetic test is 48. If a 
typical sample of 35 of your p\ipils makes a mean of 45 and a standanl 
deviation of 12, what are the odds that the true mean for your school is up 
to norm? 

5. What are the odds tliat the true mean for this partic.ular sample is tip 
to norm, if the reliability of the test is 0.80? 

6. From how large a population must an r of .20 have b(‘(‘u computed if it is 
to be as much as three times its standard error? 

7. Develop a formula for the standard error of V (tlu' ooc.iTicient of varia- 
tion), Suggestion: take logarithmic derivatives, rcnuuuber that tlu^ cor- 
relation between means and standard deviations is zero, and frtse your final 
formula from all terms except V and JV. Compare your formula with the 
accepted one (which you will find in Holzinger^s text and in several others). 
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CHAPTER VI 

THE RELIABILITY OF DIFFERENCES 


The reliability of dilToreaccs is an even more important matter 
than the reliability of statistics of separate groups. For cus- 
tomarily we wish to make comparisons and then wo need to 
know, when we find differences by such comparisons, whether 
they can be explained on the basis of chance fluctuations alone 
or whether they indicate true differences. 


THE STANDARD ERROR OF THE DIFFERENCES BETWEEN MEANS 
We may regard our means as deviations from the means of 
all the samples of their res})C(*.tivo series, and this will simplify 
the algebra. If S is the numbc'.r of samples we get, by the ordi- 
nary definition of standard deviation when the items are in 
deviation form, 

2 _ — nip)^ _ . "Zml 

~ S B "■ 'is 


The first term is and the s(u;ond term In the third term 
we shall multiply both the numerator and denominator by 
and have 




+ 


/So* 


O' 


As a part of the last term we now have r betwenm the means, 
so that wo may rewrite the oxpnwsion as follows: 

(A) "4" — 2VfntimyOmi»Omy 

We have next to stick a simpler value for the r between the means, 
which appears as a disturbing factor in formula (A), If we let 
xi, x^f xs, * * . , Xn, reprcisent the successive scores within a 
sample of the x series and a similar arrangement represent the 
scores in the corresponding y series and we conceive these scores 
as deviations from the means of the whole aggregate of samples 
in their respective series (as we must if we are to be consistent We 
with the conception of the means as deviations employed above), 

100 
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we shall have 


X(xi + a;2 + iCs + • ' 

■ • + a;„) (j/i + 2/2 + J/s + • • 

• +yn) 

n 

n 



S<T my 


2(Xi + X2 + Xz + • ' 

■ • + a:„)( 2 /i + ^2 + 2/3+ • • 

• + Vn) 


Tlt^ScP mjf 

When we multiply together the two factors in the numerator, we 
shall get two types of products, those involving the paired items 
and those involving cross products between nonpaired items, as 
follows : 

+ * 23/2 + XaVa + • * • + x„yn) 

+ 2(x,y2 + Xiya + ' ' • + x^yi + • • • + x^y^-i) 

my 

It would not be far from correct to eay, as is customarily done, 
that the second type of products sum to zero since the items that 
are multiplied together are uncorrelated. But that is not strictly 
true. We have a situation precisely like the one encountered in 
our preceding chapter in connection with the standard error of a 
mean (page 131). If carried through a process similar to the one 
employed there, our development would arrive at the following; 

maCT mgmy 

Dividing through by the coeflicient of r, and then substituting the 
value we found for the standard error of a mean, 

Nrurmyffmy 

= 

Since the n is the same for each sample and the N constant 
throughout our problem, certain factors containing these terms 
will cancel, and we are left witih 



^xyn n - l\ 

N \ N -1/ 
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r = -IM. 

Since N is the total population, lixy tho sum of the products of 
paired items for this total population, and respectively, the 
standard deviations of the two total i>opulations, we have 


— Pxy 


(Coofiicksnti of correlation b(‘twocn nieaim 
in correlated series) 


(89) 


Thus it is proved that, for all samples combined, tlu^ r between 
means of successive constituent samples oqiials the correlation 
of the paired scores for tho whole population. We do not know 
tho p for the large population iV, but we may take our r*i, from 
the sample in hand to represent it for our purpose. Substituting 
Tty for in formula (j 4), page ICO, and ext.racting the square 
root of both sides of the equai.ion, 



(Standard error of tho 

2rn,<r«^cr„,„ diiTorence botwoen (90) 
two inenns) 


This is tho formula that should always be used when calculating 
the standard error of the diffenmee bet, ween means of groups 
matched on some criterion so its to involve t.h(i pres<‘nc<! of an 
element of correlation betwcien the groups compared. Unfortu- 
nately the tail of this formula, containing t,h(‘ r, is often omitted, 
in consequence of which the standard errors sis calculated are too 
high. Of course, if tho two series should be uncorrclated, tho r 
would be zero, and the formula would become, since the third 
term would amount to zero. 



(Standard error of the tUffenmoe 
between two means in ease of (91) 
nncorrolatod series) 


In either of these formulas the value of as developed on 
pa«es 133 to 135 of this volume is to bo substituted. It was 
.shown there that, if tho successive samples are to bo chosen at 
random from a largo population, if tho successive 

samples are matched with one another on a true criterion so that 
they are correlated with one another, then 



where the r is the reliability coefficient of the measuring instru- 
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ment; if the successive samples are matched with one another 
on a fallible criterion so that they are correlated with one another 
by reason of being correlated with the criterion, then 



where the r is the coefficient of correlation between the matching 
criterion and one of the samples. Using first the simplest of 
these cases, we have, by substituting in formula (90), 

(Standard error of the dif- 

— — ference between means 

_ /3r‘ + crj — 2rxydrs?y of two series correlated rqcys 

o*ma-my ^ ,^ith each other but sue- 

^ cessive samples in the 

same series random ones) 

Note that the N belongs under the radical sign.^ 

This is the form that is likely to be most needed in practice. 
For when, say in an experiment, we wish to compare the mean 
success of our two groups, we ordinarily wish to know what could 
be expected to happen if we drew at random other groups, subject 
only to the condition that they be matched with each other, and 
put them through the same experiment. Nevertheless we might 
have involved the other types of situations, and we shall include 
them here for the sake of making the issue thoroughly clear. 
Suppose, for example, we measured the difference in attainment 
in arithmetic between a seventh-grade group of pupils under one 
teacher and a seventh-grade group under another teacher and 
meant by our statement of the reliability of the obtained differ- 
ence what could be expected to happen if we took many measures 
of the same kind of these same two groups. Then the formula 
next to be stated would be appropriate. Substituting for 
in the case of successive groups matched on a true criterion 
(because in each series the groups are the same in the successive 
samples), we get^ 

^ This form holds only if the N is the same in both the series. Otherwise 
we must write 



* The rmm would be sero between two series of means which remain on a 
constant level except for random fluctuations in successive sS-mples. 
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^ W*— nty 



^xir) 


I ^5(1 ^vif) 


(Standard error of a difference between 
means when successive samples are 
matched on a true criterion) 


(93) 


If the samples are not the same pupils repeating the experiment 
but instead they arc pupils of the same ability as those upon 
whom the first experiment was done (if, that is, they are always 
matched with the original groups in their own series on a fallible 
criterion, so that the successive groups would always have the 
same educational age or the same general intelligence or the 
same socioeconomic status as those of the earlier experiment), 
then the formula would become^ 


' ma— Wy 




’ ^(i - ^ ?3lLr_LQ 




N, 


(Standard error of a difference between 
nieanH when successive samples aro 
matched with the initial one on a 
“fallible” critorion) 


(94) 


Where the groups between which differences of means are 
taken have been matched by matching individuals, which is the 
case in well set up experiments (see page 448), the standard 
error of the difference between the means can bo put into a form 
far simpler for computational purposes than the above. For 
here we have paired scores so that the differences may be taken 
between these paired scores, and operation with these d’s makes 
unnecessary the computation of a coefficient of correlation. 
Recall the formula for an r, which we developed on page 101, 


r s SidLfr-1.fl 

2<rx<ry 


We shall substitute this value for r in formula (92), cancel 
terms that permit canceling, and find an extremely simple 
formula resulting. 


r* + (tJ - 


2 


ol) 


2(raO‘y 




N - 1 


‘ This is the formula given by Lindquist, although he does not indioaie 
the limitation under wldch it must be used. See J, Bdue. Ptyehol., Voi. 22, 
pp. 197-204 (1981). 
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(Standard error of the difference 
between means in terms of the 
differences between paired 
scores) 

The {N — 1) instead of N is important in small samples, and in 
very small samples t should be used with Student’s distribution 
instead of the normal distribution. 

Thus, in the case we shall ordinarily be dealing with (successive 
samples chosen at random but the two series matched in each 
sample), the standard error of the difference between the means 
of paired groups turns out to be merely the standard deviation of 
the differences between paired scores divided by the square root 
of the number of such paired scores. Although this formula 
relieves the worker of the necessity of computing any r between 
the series, it takes full account of the value of the r. In a later 
chapter on the technique of controlled experimentation we shall 
show that there are many additional advantages accruing from 
this arrangement beyond the one of ease of operation. If the 
two series are not correlated, the r that equals zero will auto- 
matically take care of itself just as well as any other r. We 
shall show an example of this method of computing the standard 
error of the difference between means by utilizing a table from a 
controlled experiment on the effect upon achievement in geometry 
from requiring failing pupils to remain after school hours. ^ 
In the first column are shown the “standard scores” (z scores) 
of both members who made a pair indicating their prospective 
capacity to learn, the “free” group on the left, and the “kept” 
on the right. The other columns give in succession the score 
on the test earned through the semester by the “free” pupils, 
the score by the “kept” pupils, and the differences. It is this 
last column from which we compute our standard error. 

The difference between the means of the two groups is 
(15.8 — 15.4 = 0.4). The standard deviation of the column 
of differences is found, by calculation, to be 3.28. This divided 
by the square root of 22, which is the number of cases minus 1 
(to take account of the fact that the numerator is <r instead of ?)» 
will give the standard error of the difference between the means. 

^ From a master’s thesis at Penosylvaiua State Ciollege by Bertha A. 
Swartz, 


_ ffd 


t2 

CTd 


\/N - 1 
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3.28 divided by \/^ gives 0.7. Thus while the difference is 
0.4, its standard error is 0.7, so that the difference is only 0.6 
of its standard error. From this comparison we conclude, 
therefore, that, while there is a slight difference found against 


Table XI. — Illtjstrating the Computation of the Standard Erhor op 

A Difference 


Matching scores 

Attainment score.s 

J)i (Terences 

Free 

Kept 

Free 

Kept 

1,63 

1.64 

22 

10 

6 

1.24 

1.19 

21 

21 

i 0 

0.98 

0.94 

18 

15 

3 

0.74 

i 0 68 

16 

16 

0 

0.55 

0.58 

16 

20 

4 

0 54 

0 49 

17 

19 

- 2 

0.37 

1 0 37 

18 

13 

5 

0.12 

0.13 

15 

16 

- 1 

0.30 

0 45 

17 

17 

0 

0.09 

0 13 

16 

16 

0 

0.24 

-0.04 

14 

13 

1 

-0.24 

-0.20 

14 

18 

- 4 

-0 25 

-0.25 

14 

17 

- 3 

-0.33 

-0.33 

17 1 

11 

6 

-0.37 

-0.39 

16 ' 

15 

1 

-0.40 

-0 59 

18 

13 

5 

-0.54 

-0.37 

14 

14 

0 

-0.33 

-0.29 

9 

16 

^ 7 

-0,13 

-0.13 

16 

14 

2 

-0.81 

-0.90 

10 

13 

. 3 

-0.91 

-0,91 

14 

14 

0 

-1.24 

-1.40 

15 

12 

3 

-1.92 

-1.69 

16 

15 

1 

Means 


15.8 

"' 15,4 

OA 


keeping after school, it is a difference of practically no Hl.atiHticai 
significance. 

It is suggested that the reader work out the standard error 
of the difference between the means for this problem by the long 
formula (92) and prove to himself that the two formulas give 
identical results and that the short method is far more economical. 
The short method necessitates pairing individuals but so does 
the calculation of the r for the long method. However, in some 




THE RELIABELITY OP DIFFERENCES 


167 


problems involving very large numbers of cases, or in cases where 
the n is different in the two populations, it may be enough to 
determine our r from a sample of the whole population, in whif'h 
formula (90) may be more economical. 

Standard Error of the Difference between Mean Gains. — Vei-y 
frequently we have a situation in which we measure gains made 
by groups through a period of time and wish to determine the 
statistical significance of the difference between the mean gains 
of two groups. Thus we may be interested in comparing the 
mean gain in speed of reading made in a semester by a group of 
pupils of given average mental age wdth the mean gain made by 
a control group that has had no such drills but which control 
group has been matched with the drill group on some such index 
of learning ability as IQ’s. This is a more complex problem than 
the one where we merely compare one mean with another. 
Letting z represent the scores of the one group (in deviation 
form) and y those of the other group, 1 indicating the scores at 
the beginning of the period and 2 those at the end, the following 
formula would state our case: 


(T 


2 




S(m*, - - my^ + 

S 


If the reader will square the polynomial of the four terms and 
carry through a process of substitutions parallel to the one we 
did above in connection with the standard error of a mean, he 
will arrive at the follo\ving formula: 


^ ( wijiijj— w* j_) -“ ( m 


Vat 


+ V*, 


(Standard error of the difference 

d- 2rx,v?x?v. -■ 2ra« cfa, efy )i between mean gains by cor- (96) 

related groups) 


This is the correct formula which must be used for exactness 
when employing the conventional method. Lindquist gives 
this formula with the last four terms of the tail omitted.^ It 
is true that, since two of them are positive and two negative, 
they would largely cancel one another; but not completely so, 

1 Lindquist, P. E., “On the Determination of Reliability in Comparing 
the Final Mean-scores of Matched Groups,’’ J. Educ. Psychol., Vol. 20, p. 105. 
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nnlfiaa the two groups are independent. We shall show that an 
immensely simpler formula is identical in value with this long 
one. Using the same symbolism as above/ 

{xi — zi) — (2/2 — 2/1) = (p» — Sv) = 4 ‘ 

the difference in gain in the case of one particular individual. 
Summing for all individuals in the group and dividing by JV, 

/ Sa :2 SjiA / S2/2 _ ^ _ SgA _ / SdA 

yw Wj \N n) \N n) \N ) 

Therefore, by reason of the meaning of a mean, 

— (m„^ - - mg) ~ 

We may now express, for a series of samples, the standard 
deviation of each of the quantities between which equality is 
indicated in the above equation. Since the items that constitute 
the sigmas for the three series involved in the above equation 
are severally equal, the sigmas obtained from them must be equal. 
Therefore, 

But the standard error of any mean, including, of course, the 
standard error of the mean of the d’s involved in the last expres- 
sion at the right in the equation last above, equals the standard 
deviation of the distribution divided by the square root of the 
number of items. Therefore, erm^^ equals 9gJ-\/N, where d 
stands for the differences between the paired gains between the 
X and the y series of the sample in hand. Thus wo obtain a very 
simple formula for the standard error of the difference between 
mean gains in correlated series, parallel to the one for means, 
as follows: 

ffj (Short formula for the standard error of 
) = “Tf? the difforenco between mean gains in ( 97 ) 
V N correlated scrios) 

Sometimes the statistical significance of the sum of means is 
wanted instead of the difference. Sometimes, too, what is 

' A derivation along the same lines as that given on p. 164 is also available 
here; but the proof is considerably more lengthy and the simple derivation 
given here seems sufficient. 
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wanted is the standard error of the sum of gains instead of their 
difference, especially in rotation experiments. Whatever the 
combination of means involved, the worker can make his own 
formula by constructing a polynomial from the combination of 
means designated and setting up a formula parallel in structure 
to our long ones (90) and (96), carefully watching the signs. 
But in every case of matched groups, no matter how complicated 
the combination of means required, a corresponding short formula 
may be employed, which will be algebraically identical with the 
long one and will involve the full force of each r, by merely 
performing for each combination of paired variates the algebraic 
additions called for among the means, taking the standard 
deviation of these sums, and dividing this standard deviation 
by the square root of N. Thus 

g=, (The standMd error of any 
IMS* wit* flii* ■ • . *wi]b) coixihmation of means m (98) 

viv the case of matched groups) 

The operation of these formulas will be further illustrated in 
connection with a later chapter on control'ed experimentation. 

Interpretation of the Standard Error of the Difference between 
Means. — Perhaps it may be well to pause here again to consider 
the interpretation of the standard error of a difference between 
means. The interpretation is essentially similar to that of the 
standard error of a mean except that we are interested almost 
exclusively in the relation of our difference to a hypothetical 
difference of zero. We shall take as our concrete example the 
one shown in the table from Miss 
Swartz’s study of keeping after 
school, page 166. Here the differ- 
ence was 0.4 and the standard error 
of the difference 0.7, showing a 
slight advantage for not keeping 
after school. We are interested in 
knowing what the chances are that, 
with further sampling, the advantage may not descend to 
zero and pass to the other side. We are interested, then, 
in the hypothesis that the true mean may he as low as zero. 
We abn.1l construct a normal distribution of assumed differ- 
ences with the mean at zero. If the true mean of all the 




170 


STATISTICAL PROCEDURES 


differences were at zero and the standard error of that mean 
were 0.7, some differences would go as high as the 0.4 we 
obtained from our sample, viz,^ all those above CD, In the 
trapezoid ABCD with a base of 0.4/0.7 = 0.6<r there lie 22.5 per 
cent of all the oases in the distribution. Thus above the point C, 
at which our obtained difference lies, would bo 50 — 22.5 equals 

27.5 per cent of the cases, while below that point would lie the 
50 per cent in the lower half of the distribution plus the 22.6 in 
the trapezoid or 72.5 per cent of the cases. So out of every 100 
samples 27.5 would be expected to give differences of 0.4 or 
higher even though the true difference were zero, while the other 

72.5 would give differences of loss than that. If, howev(n*, the 
true difference is as low as zero, sojmething has bappemed to us 
in this experiment that would happen only 27.6 times out, 
of 100. The chances arc 72.5 to 27.5, or 2.6 to 1, against sm^h 
a coincidence. These chances are something, but they fall far 
below giving us practically complete assurance that we liave 
not gotten the advantage on the side we did mcuvly by reason 
of chance fluctuation; henco we say that the diffc^rimeo has 
negligible statistical significance. 

This is the type of interpret, ation that we .shall pra(*ti(*all3^ 
always want to place upon the standard error of a differcMice. 
A number of writers of elementary textbooks on si.atistit^s give 
for practice elaborate problems about the chances that t,h(* (.rue 
difference is not less than a certain amount or n\ort^ t ban a (H'rl.ain 
amount or between certain specified amounts wht‘u tlu^ obtained 
difference and the standard error are spc^nfiod amounts. But 
such problems are rather artificial; the autliors of this hook 
have never yet encountered a practi(ial n^searcli prot>l(*m in 
which such interpretations were needed. Bc^sidc^s, it will be 
found that the solutions intended by these wnt(n\s for t.heir 
artificial problems turn upon placing the ohtainvd at 

the middle of the distribution — a wholly unwarranted procedure 
— which fundamental error makes fairly simple the stattutumt of 
a solution that, while not impossible, is difficult and awkward 
when correctly put. 

What we have said about the interpretation of the reliability 
of a difference between means will hold true for all the other 
differences we shall discuss throughout the remainder of this 
chapter — subject to what is said later about small samples. 
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STUDENT’S DISTRIBUTION FOR SMALL SAMPLES 

Since the N in the example we have been using here is rather 
small (23 cases), it will constitute a good one for showing the 
application of Student’s distribution for small samples and for 
comparing the interpretation by the small-sample technique with 
that for large samples. The assumption we made above that a 
large number of means (or differences, or other statistics) could be 
expected to group themselves in a normal distribution about the 
true value holds approximately for small samples as well as for 
large ones. If wo could divide the deviation of the mean (or 
other statistic) by the true standard deviation of the whole 
population of such statistic to get tj the i’s would also be normally 
distributed. However, wc do not know this population standard 
deviation but must use instead an estimate of it, s. When ^’s 
are obtained hy dividing the deviation of a statistic by s instead 
of their distribution is no longer normal. In 1908 an English 
scholar who modestly signed his name Student worked out 
mathematically the distribution^ of t (which he called z) when 
thus obtained by dividing the deviation of a mean from the 
hypothetical true value by the standard deviation of the sample 
instead of by a. He dealt with the distribution of means, includ- 
ing in particular the mean of a set of paired differences like that 
of our illustrative exercise. But it is now known that the same 
distribution holds for other statistics as well.^ The distribution 
is symmetrical about the true value, just as the normal distribu- 
tion is; but it is more leptokurtic than the normal distribution 
and is different for each n. As n increases, the distribution 
approaches normality. The reason is that 5, the estimate of the 
population variability, becomes a better and better estimate of ^ 
as n increases in size and s approaches o' as n approaches infinity. 

Stud ent fou nd the standard deviation of his distribution to 
be l/V-^V — 3. His differs somewhat from the 3 of the normal 
distribution but rapidly approaches 3 as iV increases.® In his 

1 Student, **The Probable Error of a Mean,’’ Biometriha^ VoL 6, pp. 1-25 
(1908). 

*For a more detailed, and yet simple, discussion of thQ small-sample 
technique we suggest L. H. 0. Tippett, The Methods of Statistics^ W i lli am s 
and Norgate, 1937, Chap* 5* 

» /3i » 3 + 
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original article he carried his table only to N = 10, showing 
that beyond that point a good approx imation is reac hed by 
dividing the o- of the sample by -s/N — 3 instead of by ■\/N — 1 
and using the normal curve tables. But later (1917) ho extended 
his table to iV = 30, and still later (1925) Fisher, with Student’s 
blessing, redeveloped Student’s integral in terms of {N — 1), 
and Student made new tables. It is these 1925 tables from which 
our tables in the Appendix (Tables XLV and XL VI) are taken, 
although we table the tail of the distribution from t to plus 
infinity while Student tables the area under the curve from minus 
infinity to t, so that our values are his subtracted from one. 
Our table gives directly the probability of obtaining, on the basis 
of chance alone, a f as large as the one in hand deviating in the 
sa m e direction from the hypothetical value as the one in our sample. 

Student carried his 1925 table only to n = 20 (»' = iV = 21). 
His reason was that beyond that number the shape of his distribu- 
tion was so nearly normal that the normal curve tables give good 
enough result s, provi ded one divides t he stand ard deviation of the 
sample by s/N — 3 instead of by ■\/N — 1. But Student pro- 
vided a supplementary table for dealing with n’s above 20, if 
precise probabilities arc wanted. We reproduce this as Table 
XL VI. It involves interpolating from an n of infinity as follows: 


<0 = V 4- 4- £l 4- £i 4- £i 
^ ^ n ^ ^ n* 


where p is the desired probability, p„ is the value given in the 
last column of Table 3QjV for n = infinity, and the c’s are 
given in the body of Table XLVI. Although Student’s tables, 
which were published in Metron (Rome, Italy) in 1926, have been 
little used and little known by American research workers, they 
contain the bases for the most precise interpretation of probabili- 
ties anywhere available for the type of application for which they 
were intended. (Student reports that the corrections provided 
in his table of e values, our Table XLVI, give approximations 
to the order of 0.000005.) Fisher’s table of the distribution of 
Student’s t, which is the one bcjst known in contemporary 
practice, is intended for hurried use in making rough interpreta- 
tions. Both have a place among research tools. We shall show 
how to use both tables, employing the data from Miss Swartz’s 
experiment for the purpose. W e shall compare the values from 
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^ This table is taken by permission from Statistical M^hods for Research Workers by R. A. Fisher, Oliver Sc Boyd, Edinburgh, and attention is drawn 
to the larger collection of tables m Stotiaieal Tables by R. A. E^er and F. Yates, Oliver & Boyd, Edinburgh. 
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both of these tables with the values from the normal distribution. 
Let us consider first Student’s table. 

The N in Miss Swartz’s experiment was 23 (n — 22), and the 
t was given (page 166) as 0.6 in round numbers but more precisely 
should be 0.572. In the normal curve for a t of 0.572 we have in 
the upper tail of the distribution (Table XLIV) 0.2836, which 
means that we could expect to get as large diffei’once as w'e did 
in favor of the “free” class about 28 per cent of the times (28 
times in 100) even if the true difference was zero. We now 
compare that with the probability indicated by Student’s 
distribution. Going to Student’s table (page 489), wo do not 
find a column for n = 22. So we mtist interpolate as stated 
above, which we do from the last column in T'ablc XLV aided 
by Table XLVI. Since we do not have a row for t = 0.572, we 
must find values for t = 0.5 and then for t = 0.6 and interpolate. 
For t = 0.5, 


p = 0.3085375 + 


0.0550102 

22 


0.008509 

22 “ 


0.00697 0.0022 

22 ’' 22 <“ 

= 0.3110 


For t = 0.6, by the corresponding formula, p = 0.2773. By 
linear interpolation between these for t = 0.572, p = 0.2852, 
to four decimal places. More exact work would require more 
refined methods of interpolation than the linear one. But 
practical purposes in research would probably never require 
such refinement. 

In this problem the discrepancy between the results by 
using Student’s distribution and those by using the normal curve 
is wholly negligible; the probability is 0.2852 by the one method 
and 0.2836 by the other. But the discrepancy would be much 
greater farther out in the tail of the distribution. For example, 
if the ra is 40 and t — 4.0, the odds by the normal curve table are 
32,000 to 1 while those indicated by Student’s table are only 
7,500 to I, which is a tremendous discrepancy. If the odds are 
very high and it seems worth while to state them, they should be 
determined from Student’s table rather than from a table of the 
normal distribution integral even though the n reach several 
hundred observations. Otherwise the estimated odds may be 
greatly exaggerated. (See page 170 for meaning of odds in con- 
trast with probability.) 
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We shall now illustrate the use of Fisher’s table with the 
same data. We give this table on page 173. Since Fisher’s table 
is intended for only hurried, rough interpretations, it gives 
values at only certain significance levels, and it is sufficient 
to estimate the probability in relation to these levels. We 
enter Table XII, page 173, with n = 22 and follow along row 22 
until we come as near as we can to 0.672, which is the value of 
our t. Under column headed 0.6 we find a t of 0.532 and under 
column headed 0.6 a i of 0.686. Since our t of 0.572 lies between 
these two, we say that the probability is somewhere between 
.60 and .50. This is the probability of getting as bad arithmetic 
fiias-we did, even though the true difference were zero. That is, 
it gives the probability of getting on the basis of chance fiuctua- 
tion a < that deviates either positively or negatively from zero as 
far as the one we have in hand, hence it gives the sum of the areas 
in both the upper and the lower tail of the distribution of t’s 
outside the range ±t. To find the probability of a divergence 
in the same direction from zero as that of our sample and hence 
to make the interpretation comparable with that made above, 
we must divide these entries by two. Doing this, we find the 
probability to be somewhere between .25 and .30, which agrees 
with the determination of .2852 from Student’s table. Fisher’s 
table makes no provision for probabilities lower than 0.01 (or 
.005 on one side), which corresponds to odds of 199 to 1, nor for 
n’s higher than 30. 

The probability of a true difference beyond zero in the above 
problem is so low that we were not justified in elaborating 
upon it in the refined manner we employed. We did that merely 
to illustrate the method. The proper thing would have been to 
dismiss the difference as insignificant immediately upon finding 
the very low t, or at any rate to investigate only roughly the 
probability of a true difference above zero. Many people 
believe that a point of reference should be set up as a norm for 
acceptable reliability. For many years American students have 
set a i of 3 as such standard. They called a difference reliable if 
it was three or more times its standard error and unreliable if it 
feu below that point. That is . a very exacting standard; it 
demands that the odds be at least 740 to 1 that the true difference 
is above zero in the direction of the obtained one before it be 
accepted as reliably established. The practice that follows the 
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Fisher lead puts acceptable reliability in terms of fixed probabili- 
ties rather than in terms of fixed abscissa values, so that the 
technique may be extended to small samples as well as to large. 
As we saw above, the area in the tail of the distribution of t is 
dependent upon the size of the samples, and so it is convenient to 
keep the probability constant while n changes. Most of the 
Fisher tables are constructed on the principle that we care only 
to know if the probability is as low as 5 per cent, or if as low as 
1 per cent, that the difference could have arisen by chance. 
K it reaches 5 per cent, he calls it significant; and if it reaches 
1 per cent, he calls it highly significant. In view of the manner 
in which the Fisher tables are constructed, his 6 per cent cor- 
responds, in the case of a normal distribution, to a i of 1.96 and 
his 1 per cent to a i of 2.58. 

There may be some practical convenience in having some such 
commonly understood points of reference to mark “limits of 
confidence.” But we wish emphatically to warn our readers 
that any such limits are entirely arbitrary. Nothing happens 
at these points that is unique. Reliability is a matter of degree; 
the larger the t the higher the reliability. To employ those points 
of reference mechanically is quite misleading and unwarranted. 
On the contrary, to state the issue in terms of probabilities 
and secondarily to observe that the ratio falls short of, or reaches, 
the conventionally accepted standards, is an effective way of 
preventing one's thinking from becoming overmechanical- 

If, instead of caring to test the hypothesis that the tnio 
difference may be zero, the worker is interested in determining 
the limits between which he may claim, with a given degree of 
confidence, that the true difference lies, he should recall what 
was said on pages 137 to 139 about fiducial limits. 

THE STAKDARD ERROR OF ABTY DIFFERENCE 

Since the formulas for the standard errors of all differences are 
fundamentally alike, we may as well consider at once the general 
case. Let a stand for any statistic we please (mean, standard 
deviation, coefficient of correlation, proportion, or what not) 
and w for any other statistic, whether of the same class or of a 
different class. Then, if we conceive these as deviations from 
the means of their respective series, 
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S(a — «)* _ Sa:“ 2So:<o 

-s ~ s ■‘■“S" ~S~ 


In the expression farthest to the right, the first term is a-^a, and 
the second is We can put the third into a form that involves 
an r if we multiply both the numerator and denominator by 
ffao-u. Making these substitutions, we have 


ff 


2 

a-^ 


+ 0-2^ — 2 


Saco 

/So* aO" CO 


• (TetCTu 


The reader will recognize in the expression Saco/So-acro, the value 
Tecto- Substituting this and taking the square root 

- Vrt + A - “S' (99) 

In all our further developments we shall need only to substitute 
our particular statistics for the a and the to. The standard 
errors of the individual statistics were given in our preceding 
chapter. Our new task will center in finding a value for the 
Taa for the several statistics so that we may substitute it in the 
general formula. If we were concerned with the sum of statistics 
rather than with their difference, (a + w) would replace (a — «) 
in the above development, and we would have 

<r\ + <r% + 2r„„crB<r„ any gum) (100) 


THE NULL HYPOTHESIS 

Formula (99) and adaptations from it operate on the principle 
that the two classes compared might be different, and hence we 
estimate for each its own variance. We next concern ourselves 
with both the extent of the difference and, perhaps, with the 
possibility that the true difference might go down as far as zero, 
or even have the opposite sign from the one obtained in the 
sample. We could, however, start with the assumption that the 
two samples may have arisen merely as chance fluctuations in 
drawing samples from the same homogeneous population and 
that, as such, there could be no difference between them except 
what such chance fluctuation could explain. This is the null 
hypothesis, as applied to differences. It can, of course, be 
extended to include the -average difference among a plurality 
of classes (as in analysis of variance) or to the reliability of a 
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single statistic (as when we wish to ask whether an observed r 
could have arisen out of a situation in which the true r is zero), 
or to other types of situations. 

Our problem would then become that of testing the null 
hypothesis — of confirming or refuting it. Since we assume that 
we are dealing with a homogeneous population to which all of 
our classes really belong as samples, the true v of the numerator 
of our standard-error formula will bo the same for all samples 
and can best be predicted by averaging the moments from the 
several samples. Thus, for our two samples, 

, _ Sz? + Sa:i _ 2a:? + 2a:i 

® ~ (JVi - 1) -t- (JV 2 - 1) m + N2-2 

where each x is taken as a deviation from the moan of its own 
class, and N is the number of individuals in a sample. Since the 
s would be the same for both classes and the classes would be 
conceived as independent samples, the s could come outside the 
radical, and we would have, for the standard error of a difference 
between means, ^ 

(Standard error of a difference 

between means, assuming (1011 
the null hypothesis) ^ * 

Other difference formulas would take corresponding forms. 

It is entirely possible to think of the reliability of differences 
thus in terms of the null hypothesis. Its essence consists in 
speculating upon how far sample statistics might reach from 
zero in a homogeneous population and whether some samples 
from such population might reach as high or as low as the one in 
hand. If so, there can be no assurance that a real difference 
between two populations exists because the behavior of a single 
one could possibly have given rise to the apparent difference 
between the samples. Such procedure may serve rough purposes 
well enough, and some people think it is a little easier to handle 
than the more refined methods of classical statistics. But it 
sometimes leads into rather farfetched and awkward conse- 
quences. Fisher points out that it sometimes enhances the 
value of t and thus leads to a more exacting test than legitimate; 
and also that it may give results so discordant with those of 

‘ Student’s t table is to be entered with n +■ — 2. 
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the correct method that one or the other must be ignored.’’ The 
more general methods, discussed earlier in this chapter and later, 
obviate these aberrations. In the problem cited in this paja- 
graph, for example, in which Fisher finds discrepancy between 
Student’s formula and formula (101) above, completely consistent 
results would have been obtained if he had used the formula 
correctly taking account of the correlation element [formula (90)] 
and Student’s formula [which is the same as our formula (96)]. 
Formula (90) is the absolutely general case; formulas of the t3rpe 
of (91) are specialized in the sense that they apply only where 
there is no correlation; and formulas of the type of (101) repre- 
sent the still more limited ease where it is not too farfetched 
to assume that a combination of the moments from the several 
samples can predict a variance common to them. The more 
general case adds so little extra labor that it does not seem to us 
worth while to employ the cruder method of the null hypothesis. 
To envisage the behavior of statistics in successive samples; 
to take cognizance of the influence of correlation in restricting 
the fluctuations of those samples; to estimate for each statistic 
its own most likely population value instead of merely averaging 
the two together; to raise the question whether with very large 
populations these means might occupy the same position so that 
the difference would be zero; and to raise corresponding questions 
about the variabilities of the samples, about their skewness and 
kurtosis, and about the possible extent of differences with which 
other arrays correlate with each of the factors; all seems much 
more satisfying and meaningful than merely to say that, if there 
were a homogeneous population giving rise to samples of a certain 
size, some of these random samples might show as great differ- 
ences as the one we have in hand. Certainly that is true if the 
samples are large enough to give any dependability to the 
statistics in hand — say, 30 or more cases in each sample. 

These are two different approaches, and each has its plausi- 
bility. The null hypothesis is especially useful for rough explora- 
tory research in which relatively small samples are used. For 
constructive research, especially with large samples, the more 
elaborate techniques of classical statistics are needed. We 
continue with the elaboration of these, developing the applica- 
tions of formula (99) to the several types of statistics. 

‘ Fibhsb, R. a., Statislio(A 7th ed., pp. 129, 133. 
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STANDARD ERROR OF THE DIFFERENCE 
BETWEEN STANDARD DEVIATIONS 


In formula (99), page 177, we provided for the standard error of 
any difference. For our present purpose we need only substitute 
in this general formula <r» for « and for w. We shall then 
have 

We know the sigmas of the sigmas (<r, = <r/\/2iV), so that we 
require only the coefficient of correlation between standard 
deviations in series of correlated arrays. We shall now proceed 
to determine a value for r,,,,. It is most convenient to approach 
that through ras,,!, and then to return to the unsquared v’s. 

We shall take our a:’s and y’a as deviations from the means of 
their respective samples; but the a:®’s and the will, of course, 
not then be in deviation form. Our formula for r will be 



where S is the number of samples and N the population within 
each sample. But it will be observed that in this expression 
all our quantities are of the form 'Zx^/N or The former 

is the expression for the mean of the x^'s and the latter for the 
mean of the y^’s. We have, therefore, a case of the r between 
means of samples, which was shown (page 162) to equal the r 
between the variates within a sample. Wo may, thisrefore, write 


iB) 




Nl,x Y‘ - • 23^2 




In the lithoprinted edition of this book we showtd that 


^ = <r»v2(l - + /3*r»), 


so that, assuming that = 3, + 2r®). We 

shall shortly substitute this value in the r formula. But first 
let us find a simpler value for Sx* and Xy* of the denominator. 
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In a normal distribution /Sj = 3. 


|32 


Zx* 

N(<T^y 


Therefore, clearing of fractions, Sa:* = 3Nff*. Similarly 


22/^ = 3Nc*. 


Substituting these three values in the r formula, we have, 

= + 2r»)] - 

” VN(3N4) - iVVViV(3iV<7j) - iVVj 

= + 2r^) - JVV^<r; 

V^N^4 - fVVV3iVVJ - JVV* 

The term N-a^l can be canceled out of the numerator and the 
denominatoi’, so that the expression will simplify to 

1 + 2r2 - 1 2r2 , 

vr=-iV3^ V 2 V 2 


This is the coeflBlcient of correlation between the sigmas squared. 
What we desire, however, is the r between the sigmas, not that 
between the sigmas squared. Unfortunately no simple formula 
can be given for the relation between the r between measures 
and the r between those measures squared. It depends upon 
the origin from which the squared measures are taken. We can 
show, by a process of development which it is scarcely worth 
while to reproduce here, that, assuming homoscedasticity and 
mesokurtosis, 


r,ay4 


4 ' 


(r between squared measures 

^ — in terms of r between the (102) 

(Ty {<rl + 2ml) measures) 


(4. + 2mg), 


where is the standard deviation of a column in the correlation 
table while <ry is the standard deviation of the whole y distribu- 
tion. As the m increases indefinitely in comparison with the 
<r's, the fraction involving the parentheses approaches 1 in value, 
and our expression becomes 
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But this is also the formula for In our particular applica- 
tion, the mean will customarily be large in comparison with the 
variabilities, so that we may take the r between the sigmas 
squared to be substantially the same as the r between the sigmas. 
Therefore 

« _ «2 (Coefficient of correlation between standard /h 

^ deviations in correlated series) 


Substituting this value in the formula for the standard error 
of the difference between standard deviations, given at the 
opening of this section, and employing numerical subscripts, 




(Standard error of the 
difference between 
standard deviations) 


(104) 


If the N is the same in the two series, we may conveniently 
substitute a/ y/ W for nc and have 

- ^/(<^ + ^ (104«) 

The application of this formula to an experimental problem will 
be illustrated in our chapter on experimentation, pages 455 to 46G. 
See those pages also for a different formula for small samples. 


THE STANDAKH ERROR OF THE DIFFERENCE 
BETWEEN PROPORTIONS 

In applying our general formula for the standard error of any 
difference we need only to know the r between proportions in 
correlated arrays, since we already know the standard errors of 
the separate proportions (page 146). If, in computing propor- 
tions, we look upon each individual as scoring one point when 
present and no points when absent, as is the customary way, a 
proportion equals hz/N, where N is the whole population and 
Sa is the number present in the count. The mean score would 
also be 'ZzJN, where the symbols have the same moaning. The 
correlation between proportions would, therefore, bo the same 
as the correlation between means, which we have already shown 
to be equal to the correlation between the variates within the two 
matched samples. That is, (^tir formula would 

then become 
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(Standard error of the difference between pro- 
portions in the case of matched groups; ■ 

In groups selected from the two populations at random instead 
of matched on some criterion correlated 'vjdth the outcome with 
regard to which we are measuring proportions, the r would be 
zero, and the tail of the formula would drop oflp, so that we would 
have 



It is seldom that the former of these formulas can be employed, 
for it is seldom that we know the correlation factor when dealing 
with proportions. The possibility of its use may be illustrated 
from a study by Freeman and Hoefer on the influence of motion 
pictures upon conduct.^ They match two groups of children on 
information and intelligence test scores, then they show to 
one group motion pictures propagandizing for clean teeth. 
After the lapse of sufidcient time to permit the instruction to 
function, they ascertain, among other things, what proportion 
of each group possessed toothbrushes. It was found that 99.48 
per cent of the group that had seen the motion pictures owned 
toothbrushes while 97.65 per cent of the nonmovie group pos- 
sessed them. The investigators do not report the coefficient 
of correlation between the two groups in respect to owning 
toothbrushes when matched for information and intelligence; 
it would need to be computed by the tetrachoric method described 
on page 366. Let us assume, for purposes of illustration, 
that this T turned out to be .30. We would then have (since per 
cents are proportions multiplied by 100) 


(99.48) (.62) 
192 


(97.65) (2.35) 
170 • 


2(.30) , 


/(99.48) (.52) (97.65) (2.35) 
' (192) (170) 


5'Frbbmait, Feank N., and Caroltn Hobfbb, *^An Experimental Study 
of the Influence of Motion Ketutes on Behavior/^ JSIduc. Psychol,, Vol. 22, 
pp. 411-426 (1931). 
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which equals 1.12 per cent. The diiference itself is 1.83 per cent, 
so that the ratio of the difference to its standard error is 1.63. 
This is to be interpreted in the same manner as in our illusi.ration 
with the difference between means, page 169. Referring to our 
table, page 486, we find that a ratio of 1.63 indicates chances 
of 18.2 to 1 that a real difference exists in favor of the children 
who had been instructed by means of the motion pictures. If 
we did not employ the tail to the formula but instead ignored the 
correlation element, we would get from the first two terms a 
standard error of 1.27. This would give a ratio of 1.44 between 
the difference and its standard error, which would indicate 
chances of 12.5 to 1 that a real difference exists in favor of the 
motion-picture group. 

We shall illustrate the application of the second formula 
(106) from a study made by C. N. Eabold on the differences 
between country pupils and town pupils.^ Eabold ascertained, 
among 38 other things, what proportion of 71 high-sc.hool 
pupils who came from the open country and of 65 pupils who came 
from a small city are employed after school hours. Ho found the 
proportion to be 57 per cent for the country and 51 per cent for 
the town, a difference of 6 per cent. Is this sufficient difference 
to indicate that repeated sampling of the same kind of populations 
would continue to show differences on the same side and that the 
theoretical (true) difference obtained from an infinitely large 
population would show a larger proportion of country pupils 
of this type of population employed afUir school hours than of 
town pupils? Since the groups selected were random ones, the 
formula without the correlation clement is the correct one to 
use in getting an answer to the question about reliability.' 
Substituting our particular values for the symbols, 

,, _ liMiMTTMM = 085 

Thus, while the difference is 6 per cent the standard error of 
that difference is 8.5 per cent. The difference is only 0.7 of its 
standard error. A ratio of 0.7 between a difference and its 
standard error indicates chances of only 3.1 to 1 that the true 
difference lies in the same direction. This is extremely low 

* Rabold, 0. N., and C. C. Pbtbes, “How Country Pupik Differ from 
Town Pupils,” J. Ed. Social., Vol. 3, pp. 297-306. 
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statistical significance, so that we must conclude that we cannot 
trust a difference so small in comparison with its standard error 
as proof that more country pupils are employed after school 
than town pupils. 


THE STANDARD ERROR OF THE DIFFERENCE BETWEEN TWO 
COEFFICIENTS OF CORRELATION 


Substituting r’s for the a and the a? in our general formula, 
we get 


0 " f — f* ““ 


“h (T? — 2rr T O’r CTr 


(107) 


From our previous chapter we know the <t^s of the r’s. We need 
only a value for the r between two r’s. We would scarcely be 
justified here in taking the space necessary to develop these 
required formulas. Pearson and Filon^ give them for the two 
cases as follows: (1) the case in which the same array occurs as 
one factor in both the r’s; and (2) the case in which the four 
arrays are different. But all the arrays are somehow correlated 
with one another; otherwise there would be no correlation 
between the r’s. The first case is as follows: 


rr 


u’'ll 


r-i2ri8(l — rfs - 

2(1 - r?,)(l - r? 3 ) 

(Coefficient of correlation between 
two r^s having one array in common) 


(108) 


The other case involves a considerably longer formula, as 
follows: 


[(ri3 - ri2r23)(r24 — r23rs4)]\ 

4- i(ri4 - ri3J’34)(r28 - rnrum [ 1 1 

+ r(ri3 - ri4Tii){r24. — ri4ri2)]( [2(1 - r?2)(l - rIJ J 

,+ [(ri4 - ri2r24)(r23 - r24?-34)]/ 

(Coefficient of correlation between 
two r's in correlated series, no (108a) 
array in common) 


We shall illustrate the operation of these formulas with data 
from a study by H. Clair Henry on the reliability and Validity 
of the consistent-response method of. scoring a true-false test 

^Pearson, Kabl, andL. N, G. Filon, ** Mathematical Contributions to 
the Theory of Evolution,** Tram, Boy, Soc, {London), Series A\ Vol. jlQl, 
pp. 269, 262. 
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as compared with that of the rights-minus-wrongs method.^ 
He scored the Peters Test of General Information according to 
the rules for this test, viz., a credit for an item if a pupil responded 
to it twice correctly when stated in different ways and no penalty 
for wrongs, and also by the conventional rights-minus-wrongs 
method, computed validity and reliability coefficients by both 
methods, and examined the differences for sign and for statistical 
significance. As one test of validity he correlated the scores 
on the test by both methods with the recorded IQ’s of the 
pupils. We shall consider his trial with 90 senior high-school 
students. Evidently this problem comes under our first case 
since, in each of the two scorings, marks were correlated wii.h the 
same array, viz., the intelligence quotients. We shall call the 
IQ array 1 ; the R-W array 2; and the consistent-response array 3. 
The correlations Henry found were as follows: ria = .76; = .84; 

and 7-23 = .89. The consistent-response method showed a higher 
correlation with intelligence quotients by (.84 — .76) = .08. 
Is this a significant difference? We shall apply to it our for- 
mula (108). 

_ (.76)(.84)[1 - .89® - .76® - .84® + 2(.76)(.84)(.89)] 

.oy 2(1 - .76®) (1 - 84®) 

= .773 

Putting this value for the r into our standard-error formula wo 
have 




_ /(I - -76®)® . (1 - .84®)® (1 - .76®) (1 - .84®) 

~ V 90 90 2(.733) -jjg 


= .03 


Thus the standard error of tho difference is .03 while tho 
difference is .08, making a ratio of 2.67. This indicates chances 
of 263 to 1 of a true difference in favor of tho consistent-response 
method of scoring. If we disregard the correlation between the 
r’s and employ the formula in the customary manner without the 
tail, we get a standard error of .064 and a ratio of 1.48 between 
the difference and its standard error. This indicates chances 
* An unpublished inaster’s thesis at Pennsylvania State College, 1932. 
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of only 13 to 1 that a true difference is in favor of the consistent- 
response method. Evidently, if we had depended upon the short 
formula which ignores the correlation element between the fs, 
we would have greatly underestimated the reliability of our 
difference. 

In illustration of our second case we shall use Henry’s figures 
for the difference between the reliability coeflSicients by the two 
methods of scoring for 100 college sophomores. In this case he 
correlated scores from form A of the test with those for form B by 
each of the two methods. The arrays were numbered as follows: 
1 is the scores on form A by the rights-minus-wrongs method; 2, 
the scores on form B by the rights-minus-wrongs method; 3, the 
scores on form A by the consistent-response method; and 
4, the scores on form B by the consistent-response method. 
The reliability coefficient by the rights-minus-wrongs method 
would be ri 2 , while that for the consistent-response method would 
be r34. We are interested in the difference between these two r’s. 
The values of the several r’s needed in the formula are as follows: 
^12 = .52; r34 = .64; = .61; nz = .36; ru = .43; r24 = .61. 

When these values for the r’s are put into formula (108a), 
rrij,r„ turns out to be .334, When this value of r is used in 
the general formula for the standard error of the difference 
between two r’s [Eq. (107)], the standard error is found to be 
.08, giving a ratio of 1.5 between the difference and its standard 
error and indicating chances of 14 to 1 of a true difference in 
favor of the consistent-response method of scoring. If the r 
between the r’s is ignored, the standard error of the difference is 
.096, the ratio 1.26, and the chances of a true difference in the 
same direction 8.5 to 1. The use of the tail to the formula here 
makes less difference than in the previous case because the inter- 
eorrelations are rather low. 

Thus, to be strictly correct, one needs to employ the formula 
for the standard error of a difference between r’s that takes 
account of the r between the r’s. But we have taken the position 
that standard errors of r's are not to be taken so seriously as they 
customarily are, and this would extend to the standard error of 
the difference between the r’s. Since the tail of the formula 
involves the computation of additional r’s probably not needed 
otherwise in the problem and. since we are on rather uncertain 
ground here, most people will probably wish to continue to 
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employ the approximately correct formula that ignores the tail 
containing the r between the r’s. In this form 

(Standard error of the difference 

- I -2 between two r^s in unmatched /1AQ^ 

^ series, or when the force of the 

matching is ignored) 


But when one uses this abbreviated formula whore the element 
of matching is present, he should recognize that his obtained 
standard error is probably too high, and possibly much too high. 

The Significance of a Difference between z's, — The 3 ' tech- 
nique (see page 156) is especially rccommcnd(^d by Fisher for 
testing the significance of a difference between r\s. We shall, 
therefore, apply it to testing the significance of the difference 
between the z' values of the r's wc tested on page 186 by formulas 
(107) and (109). The formula is the customary one of type 
(99) with the correlation factor omitted. It is, as inspection 
of the formula for the standard error of 25 ' [formula (88) page 156] 
would indicate, 


t = 


^12 




(Standard error ratio for the 
differcnco between two ii's) 


( 110 ) 


We need first to obtain the z' value for each of the r’s. If 
a table of hyperbolic functions is available, such as is printed 
in the Handbook of Chemistry and Physics, the hyperbolic arc 
tangent of r may be road directly from it, and that is Or 
tables covering certain ranges of z' may be found in Fisher’s 
manual and in some other books. If no such tables are available, 
the values must be obtained by the use of tables of logarithms 
as indicated by formula (87), page 155. By the use of the table 
of hyperbolic functions in the Handbook of Chemisiry and Physics 
we get as z' for our r’s 

ris = .76; a/j = 0.9962 
ru = .84; zl^ = 1.2212 


, 0.9962 - 1.2212 

t = ,1 ; ",.=aj. l „ = --1.48 


4 


'■ + ’ 


90-3 ■ 90-3 


Thus we get as our ratio of the difference between the a's and 
the standard error of that difference 1.48, which is to be inter- 
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preted by use of the normal curve functions in our familiar 
manner. That is exactly the same ratio as we obtained on 
page 186 by the use of the standard formula [Eq. (109)], and both 
ratios are to be interpreted in exactly the same manner. So 
for all our extra labor we gained nothing, in this problem, by 
transmuting to 2 ;'s; and we lost all the additional precision that 
formula (107) gave us. We cannot use with z' a formula of the 
type of (107) because the r between is unknown. 

Exercises 

1. From the data given in Table IV, pages 58 to 61, ascertain whether 
girls differ from boys in grade-point average; in scores in history. How 
reliable are these differences? (Note that these are random groups, hence 
no correlation element is present.) 

2. Match girls and boys for general intelligence scores; t.e., for each girl 
find a boy with the same, or nearly the same, intelligence test score. Then 
see whether there are sex differences in grade-point average when the groups 
are thus matched for general intelligence. Do likewise with history scores 
and with scores on the other sections of the test. How significant are these 
differences? (Remember that now the correlation element is present.) 

3. How do the sexes compare in variability: (1) when random groups are 
taken? (2) when groups are matched for general intelligence? 

4 . Are there significant differences in the extent to which the scores in the 
several functions correlate with general intelligence test scores? 

6. Revert to the matched groups of Exercise 2, Compute for each 
of the sexes the r between intelligence test scores and science scores (or other 
array in which you are most interested). Is there a statistically significant 
difference between the r for girls and that for boys? [Remember that here 
the matching element is present and hence formula (108) applies. It is 
considered that the scores on the matching element are perfectly correlated 
between the two groups, so that a single subscript may refer to either set.] 

6. From these same matched groups compute the r between history scores 
for boys and those for girls and also the r between science scores for boys and 
those for girls. Is there a statistically significant difference between these 
r*s? [Note that here formula (108a) applies.] 
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CHAPTER VII 


INFERRING COEFFICIENTS OF CORRELATION 
FOR CHANGED CONDITIONS 

the generalized spearman prophecy formula 

We shall first develop a general formula for the correlation of 
the sum of corresponding scores in a sets of similar arrays in an 
X series and the sum of corresponding scores in fe sets of similar 
arrays in a y series. The reader is asked to follow critically the 
development in this section because it will be made the basis of 
the derivation of practically all the formulas of this chapter. 

Let xi, X2, xz, . , . , Xa be scores made by one individual in 
the X series (which may be such measures as estimates by judges 
as well as scores on an objective test), and let i/i, 2/2, Vz, • • • ,yh 
be this same individuaFs scores in the y series. Let these all be 
conceived as deviations from the means of their respective 
arrays. Then, employing our product-moment correlation for- 
mula in the shape, 

T = 

we get for our particular type of data 




^ (»i+»a+-»8 • • ■ (t/i+va-Hf3+ • • • -H/fc) 

2)(Xi + X% + Xz+Xa+ • • • +Xc) 

== (yi + yg + ^3 + " * • + Vh) 

j^(xi + 2:2 + aJs + ^^4 + * • * + Xa)^ 

V 2(yi + y2 + ya + y4 + • • • + yb)^ 

Multiplying together our polynomials in the numerator and 
squaring those in the denominator as indicated, placing the 
summation sign with each member instead of before the expres- 
sions as wholes, and using a more abbreviated symbolism for the 
r between sums, 


Sxiyi + 2^xiy2 + • • • + Sxiyb + + 2xsy2 + • - • 

+ ^xzyi + * * * + ^Xayb 

/(Zx! + Sa;| + • ' - + + DX1X2 + • * • ) 

V (Syf + Syi + Syi + • • • + Syiy2 + ) 
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Since we are considering the sum of similar samples, wc may- 
take the sigmas -within the x series to be essentially equal to one 
another, and like-wise we may take the sigmas within the y 
series to be substantially equal to one another. Let us then 
di-vide both numerator and denominator of the right-hand 
member of the equation by rurx/ry, these being the typical stand- 
ard deviations of the scries to which they belong and the n being 
the number of cases in any one sample. We shall then have 


I,xiyi , "Exiyi , 'Lxiyz 




+ 


"f" 

n<7*<7j/ no‘x(Ty 


• + 




4. ^^ 2^1 ^ _|_ 23:2^8 

*i^(TxP‘y 



I ^xt 

wl ml 
Sj/? , S 2 /i 


+ 


liXiXi 2 xi 3;3 

nai 


mi. 


+ 


m: 


+ r^ + 


m: 


, ^yiVi . S?/iys 

T- „„2 ~r ^2 + 


m£ 


) 

) 


We have above two types of product moments: those of the 
type JiXiyilm^iiTv and those of the type SxiXz/ml or 'Zyiyt/ncfl. 
The latter represent the correlations within the scries of x meas- 
ures or -within the scries of y measures, being the intercorrelations 
among the samples within each set. The former represent the 
interoorrelations between the x samples and the y samples. 
Since the samples are assumed to be similar within each sot, w(5 
may represent the first type of product moments as f»„, the aver- 
age intercorrelation between the samples, or simply as on 
the assumption that those intercorrelations are reasonably well 
represented by any r*v that we may have at hand. Those of 
the second type we may represent as rj/, and ruv, the average 
intercorrelation among the samples within each set. 

Evidently there are in the numerator 06 of the rVs because 
each element of the x series, of which there are a in number, 
enters into combination -with each element of the y scries of 
which there are &. But in the denominator each enters into 
combination with one less than the whole series (itself being 
excluded by reason of having been used in the a:* or y® element); 
therefore the number will be o(a — 1) or (o® — a) on the left 
and (6® — h) on the right. Each expression of the type 2 a;*/n<r 5 
equals 1, since it is equivalent to and there are a of these 
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on the left and h of them on the right. Keeping in mind all 
these equivalents, we may write 



(Coefficient of correlation between the 
sum of a samples of an rc fun ction and (111) 

the sum of h samples of a y function) 

This is the r between sums. Since we may divide either or 
both arrays in any correlation problem by any constant or con- 
stants without changing the value of r, the r between averages 
is precisely the same as the r between sums. The formula for 
the r between the average scores in a samples of x measurements 
and h sets of corresponding y measurements, where the samples 
are similar within their own series, is thus precisely the same as 
the above for sums. But, when we quote it as the r between 
averages, we shall employ for the r the symbol Va^y, 


RELIABILITY OF AVERAGES 


We have two main types of applications for these formulas. 
The first is the type where x and y are the same function. This 
is the case where a number of judges make estimates on a group 
of individuals and we are concerned to know how closely the 
averages of these estimates may be expected to correlate with 
the sum of estimates made by these same judges, or by others 
similar to them, on another sample of individuals similar to the 
first sample. It is also the case where we have the average 
intercorrelation of a number of forms of a test in hand and wish 
to judge how closely the scores obtained from the sum of these 
forms in hand could be expected to correlate with the sums or 
the averages from any given number of similar forms to be 
obtained in the future. This is the problem of reliability. In 
this type of application all the forms may be taken as similar, 
so that all intercorrelatxons are of the type ru, whether obtained 
within set a or within set 6. Under these conditions formula 
(111) becomes 


^55 


g&rii 

+ (a^ — a)ru Vb + — b)ru 


(Predicted correlation between the averages from a 
forms of a test and the averages from o forms of 
the same test) 


( 112 ) 
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If a = b, formula (112) becomes 


5^0 — 


aril 

1 + (a — l)ri7 


(Predicted correlation between the 
average scores from a forms of a 
test and a other forms of the same 
test) 


( 113 ) 


If a is 2, this formula becomes 


„ _ 2ri7 (Spearman-Brown formula for predicting 

~ 1 ^ tnereliabilityof a test of doubled length) 


Formula (114) is the one we employ when we split a test into 
two halves (as odds and evens), get the correlation between these 
two halves, and then step this up to a prediction of what the r 
could be expected to be if taken between the whole of the test 
and another whole test instead of between the halves. It is 
very widely employed in calculating the reliability coefficient 
of a test. Mathematically it indicates what should be obtained 
by correlating two forms of a test, provided those foims are as 
closely similar as the two halves are. But in practice it will be 
found to give slightly higher correlations than those obtained 
by correlating two forms. This is because, in the case of split 
halves from the same test, conditions are precisely the same for 
the two halves — same condition of health for a pupil on the two 
halves, same degree of understanding of the instructions, same 
motivation, etc. — ^while with diflferent forms, given on different 
days or even in sequence on the same day, the conditions may not 
be the same for the two forms. These inequalities in the degree 
and manner to which changed conditions affect different pupils 
will tend to lower the correlation between forms. Sometimes a 
third method is employed in order to ascertain the reliability 
coefficient of a test: to readminister the same form of the tost 
after an interval. By this method the coefficient tends to be 
raised by reason of the element of overlapping. Thxis relia- 
bility coefficients are highest when the same form of the test is 
repeated at a reasonably short interval, next highest by the split- 
halves method, and lowest by the correlation of scores from differ- 
ent forms. 

Let us return to our general reliability folrmula [Eq. (Ill)] 
and carry it through one more step of development; let us make 
6 infinitely large. We shall then have the predicted correlation 
between the average scores from a forms of a test, or the average 
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estimates by a judges, and the averages from an infinite number. 
This average from an infinite number may be called the true 
scores, and the r between the a forms and the infinite number 
may be called the correlation of the obtained averages with the true 
averages. An examination of the formula will show that we can- 
not substitute^ infinity for b directly because that would give 
us infinity in both numerator and denominator, infinity over 
infinity, which is indeterminate in value. We shall, therefore, 
divide both numerator and denominator by 6, remembering that 
this must become 6^ when dividing under the radical sign. Then 


rz® - 


arix 


^ a + {a^ - a)ru + ^1 - ^ 


rii 


The 1/6 equals zero, since the denominator is infinity. There- 
fore, 


= 


aru 


aril 


\/a + y/r^ VarTTta*“^'a)rfj 

(Predicted correlation between the average scores /i -i c'v 
from 0 forms of a test and the true scores) 


We shall illustrate the application of some of these formulas 
from a study by one of the authors of the influence of motion 
pictures on standards of morality. ^ The investigation of motion 
pictures involved the necessity of giving them ratings on the 
degree of divergence from the mores with the guidance of 
certain scales having quantitative indices. With these scales in 
hand three judges made ratings of the scenes that fell within 
selected areas. We shall take as a sample the ratings on the 
treatment of children by parents. The average intercorrelation 
of the ratings by the three judges, computed by the method to be 
described in our next section, was .862. When this is entered 
into formula (113), we get, as the predicted correlation between 
the averages of the ratings for the several films from these three 
judges and the averages from another three of the same general 
type, the following: 

” 1 + (3 - 1).862 

1 Pbtsbs, Chabiiss G., Motion Pictures and Standards of MoralUyi The 
Macmillan Company, 1938. 
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Employing formula (115) for the correlation between the 
averaged ratings from the three judges and those to be expected 
from an infinite number, we get 


3 > .862 

V3*.862 + (3^ - 3). 8622 


.974 


The meaning of this last correlation is that, for most practical 
purposes where the average intercorrelation among judges is 
as idgh. as .862, three judges are sufficient; for then the joint 
estimates agree to the extent of an r of .974 with i/he true estimates 
that one would obtain from an unlimited number of judges. 
This is as close agreement as we would ordinarily demand. If, 
however, we decide that we would be satisfied with an r that is 
no less than, say, .99, we could put this value into our formula 
on the left and the known average intercorrelation on the right, 
and determine the number of judges (a) required to give that 
r by solving the equation for a. 

Lengthening a test increases its validity as well as its reliability. 
If we measure validity in terms of the correlation of the test 
with an outside criterion and assume that there is one form of the 
criterion, formula (111) becomes 

(Predicted correlation be- 

^ tween a criterion and fiiA) 

4- the sum or average ot a 

V O + (.0 a)rii ^ b 


' AVERAGE INTERCORRELATION 

Average intercorrelations were called for in the formulas 
of the preceding section. A great deal of labor would be involved 
in computing these in the regular way, especially when the 
number of forms to be intercorrelated becomes considerable. 
Fortunately there is available a very simple method of computing 
an average intercorrelation if we may assume equal variabilities 
in the arrays among which the average intercorrolations are sought. 

Let s be the sum of the corresponding items across all the 
arrays in the case of one individual. Then, if 1, 2, 3, . . . , a 
number the columns, s = a:i + ajj + *8 + • * * + *<,. Squaring, 
summing for all the individuals (iV), and dividing by their 
number, 

Ss* _ 2(a:i + Zi + x»+ • • • + ®o)® 

N N 
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Squaring the polynomial and putting the summation sign and 
the N with each term, we have 


Ss* Sr? , Sri Sr| , Srir2 , hxiXz 

if = ir + i^ + i^ + -'-+n^ + -ir 


+ • • • + 


Srjra 

N 


+ • • ♦ + 


Sro— xra 

N 


The term on the left of the equation is the standard deviation 
squared of the sums of scores by individuals. The items of 
the first type on the right are expressions for the standard devia- 
tion squared of the column (i.e., is, by forms or judges). Since 
we are assuming equal variabilities among our arrays, we may 
call any one of them v?, meaning the standard deviation squared 
of an individual array. (An array is the set of scores assigned 
to the individuals by a single judge or achieved on a single form 
of the test.) There are obviously a of these o-fs, a being the 
number of arrays; since we have assumed them sufficiently 
similar to be treated as averages, their sum is ckt?. We shall 
also treat the product nibments as averages. In order to make 
r’s out of them we must, of course, multiply each by o-or/o-a, so 
that each will give us r<r*. There are (a® — a) of these, as in 
the previous development. Using a s3rmbol to indicate that 
these are averages and summing them as such, our equation 
becomes. 


o?, = ov? -f- (o* - o)(7|ri/ 


(The variance of the sum of 1 7 ) 
a similar correlated arrays) - ^ ■' 


Transposing and solving for ri/. 


Tu 


^ (<rt/(rl) - a 
{r|(a* — a) a^ — a 


(Average intercorrela- 
tion among a arrays 
of equal variability) 


(118) 


The a is, of course, the number of arrays correlated. The 
is best found array by array, then these <r®’s averaged. If all 
the scores are thrown together into a single frequency table for 
the calculation of the tn, the additional assumption must be made 
that the means of the arrays are equal. This is likely to be 
a more disturbing factor than the assumption of equal variabili- 
ties. For averaging the variances of the a different arrays, the 
following formula is convenient. Notice that, since the N is 
the number of items, it is the same for all the arrays. 



198 


STATISTICAL PEOCBDURBS 


, ifiVSZ? 




- ( 2 Zi)=* iVTSZi - (2X2)5 


X 2 Xi - (2X3)* 


N(XX\ + 2X1 + 2X1 • • • ) - ( 2 X 1 + XXl + 2X1 


X22X2 - 22X< 


Table XIII. — Ratings on 25 Pupils by 16 Fellow Pupils on 

SOCIAL-MINBEDNESS 


Ratings by 16 fellow pupils 
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Table XIII is a table of ratings made by 16 high-school pupils 
on 25 of their fellow pupils on the trait of social-mindedness. 
The ratings are on a scale of 1 to 5, with each stage defined by 
a description. The illustration is from the ‘ ‘ Survey of On-coming 
Youth in Pennsylvania” conducted by Harlan XJpdegraff. 
At the foot of each column we give the “makings” of the standard 
deviation of the individual ratings and in the two columns at 
the right the “makings” of the standard deviation of the sums 
and also of the averages. The computation’s are given a few 
lines below. For 2SX we ad d along the columns all the separate 
SX elements, and for SSXf we similarly add the s!^^’s of the 
separate columns. For the sums, column SX, is necessarily 
the same as SSX, which is 1,359. For the sums column SX| is 
77,763. The student may himself wish to solve the problem 
by way of averages. The computations by way of the sums 
follow: 

j i\rsSX2 - zTXi _ 25 • 5,265 - 117,597 
aN^ 16 • 25^ 


oi = 155.5 

_ W/<r?) - q _ (155.5/1.4) - 16 
— a 16* — 16 




aru 


16 • .396 


1 + (o - l)ru 1 + 15 • .396 


.396 

.913 


Usually when one is dealing with such data as those to which 
this section relates, especially when in the form of ratings, he 
will have in hand the averages for the individuals rated in addi- 
tion to the sums, or perhaps only the averages. Formula (118) 
may then take the shape. 


rii = 


(aWy/oi) — a _ (a<r.Vof) — 1 
0^ — 0 a — 1 


(119) 


In this form it is possible to estimate roughly the reliability 
of the ratings from the range of the averages and an estimate 
of the variability of the individual ratings. In the survey from 
which the above illustration was taken, it was necessary to 
detect, and to hold out for further investigation, those rooms in 
which the ratings seemed to have been unreliably made. Because 
there were hundreds of rooms, actual calculation would have 
been far too slow. We observed that the individual ratings had, 
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usually, a standard deviation of about 1, and we took the stand- 
ard deviation of the averages to be about one-fourth of the range. 
We, therefore, looked over the averages from the 30 or more 
pupils in a room, recorded the highest and the lowest of these, 
divided this by four, and substituted in formula ( 1 19) , or mentally 
made the substitution. Suppose, for example, the averages in a 
particular room ranged from 1.22 to 3.18, and there were 30 
judges contributing to the rating. We would have, as a rough 
estimate of the intercorrelation. 


ru 



■ 18 - 1.22 y 

30-1 


1 


6.20 

29 


= .21 


And the reliability of the average of the 30 ratings would be 


, aru (30) (.21) 

1 -h (o - l)ru 1 + (29) (.21) 


.86 


If one prefers, he may use the split-halves method for deter- 
mining reliability in such situations as we have been referring 
to in the above paragraphs. That is, one may break the set of 
raters into two approximately equal chance halves, got an array 
of sums or of averages from each of these halves, determine the 
coefficient of correlation between these halves, and apply for- 
mula (114). If the assumptions mentioned in this section have 
been fuUy met, the outcome will be identical by way of the split- 
halves method with that obtained by way of the avcragc-inter- 
correlation method, as the reader may wish to convince liimself 
by a little exercise in algebraic manipulation. 

Average Intercorrelation from Ra:^s. — If our data are in the 
form of ranks, we can put formula (118) in a different shape, 
simpler for operative purposes, by taking advantage of the fact 
that the standard deviation of any set of ranks is known. We 
treated that matter on page 107. Since the <r? is the standard 
deviation of a set of N ranks, = (IV® — 1)/12. We need yet a 
more convenient value for <rj. The average of a set of N ranks is 
the sum of the first and the last divided by 2; that is, (N + l)/2. 
Each array has this as its average rank score. Therefore all 
the a arrays together have as the sum of all their scores N • a 
times this average. That is, 
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JS = Na (5!^^), and ^ - a 

Remembering the general formula for a standard deviation in 
terms of scores, (r| = (SZ^/iV) — (SZ/JV)^ or (SZV-^V) — M^, 

we have in the case of our data, cr% = ^ The a 

has the same meaning and value as before. Substituting in 
formula (118) the equivalents just found for the two types of 
<r’s, we have 

a^(N + 1 )* a{m - 1 ) 

N 4 12 ' 


Rearranging the order of terms and placing all the terms of the 
numerator over 12 as a common denominator, we have 


Tit = 


-a(N^ - 1) 

12 


+ 1)2 12SS2 


12 


12Z 




Canceling certain terms and breaking the fraction into three 
component ones, we get 

1 Za(N + 1) , 12SS2 

l-a (Z - l)(a - 1) ■'■aZ(Z2 - l)(a - 1) 

By some rearrangement of terms this can be put into the form 
given by Kelley as follows: 


Tu — 1 


a{iN + 2) 


+ 


12SS2 


(o - 1)(Z - 1) ^ o(o - 1)(Z2 - 1)Z 
(Average intercorrelation. among arrays 
expressed in, ranks) 


( 120 ) 


Although this formula is somewhat long, all the terms in it have 
a conventional meaning, and it is easily applied in practice. It 
involves no special assumptions. 


INTRACLASS CORRELATION 

In formulas (118) and (119) for average intercorrelation the 
columns were treated as possibly somewhat different from one 
another. Consequently, we took their contributions to Oj from 
deviations from their own several means. But suppose we could 
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be sure that these columns were alike, except for chance fluctua- 
tion. Suppose, for example, we had a number of trees repre- 
sented by the rows and measurements of samples of the leaves 
from each spread through the rows. That would place the 
different trees in place of the 25 pupils and the leaves in place 
of the 16 raters. Then, since the leaves would not have been 
assigned to columns in any systematic manner, the columns would 
tend all to have the same means and the same variabilities. It 
would then make no appreciable difference whether we computed 
the tr’s of the columns from their own means or from the grand 
mean. The same thing would be true if we had, say, measure- 
ments of the texture of the teeth of brothers spread through the 
rows and the families to which they belonged represented by 
the columns. In this situation we could use formula (119) with 
<r? computed from deviations from the grand mean. Such an 
average r between sets of members of which the pairs belong to 
the same class is called an intraclass correlation. It is evidently a 
special form of average intercorrelation in which sufficient con- 
fidence can be put in the assumption that the classes are alike 
(apart from chance fluctuation) that the deviations may be 
taken from the mean of the combined classes rather than from 
the means of the several classes. On this assumption Harris’s 
formula’^ for intraclass correlation reduces to our formula (119). 
Of course, intraclass correlations can be computed directly from 
a correlation table by entering each pair twice, entering a mem- 
ber’s score on the y axis at one entry and on the x axis at the 
second entry, then computing the r from the combined table. 
The outcome is the same as if formula (119) were used, but 
the process becomes too laborious beyond several pairs of classes. 
The worker must take warning that the technique of calculating 
intraclass correlations is highly sensitive to the fulfillment of its 
assumptions; if the classes are not really alike, so that the 
assumption of equal means is not fulfilled, highly distorted results 
may follow.® 

1 Quoted by Fisher, StaUstical Methods for Research Workers, 7th ed., 

p. 220. 

* Ibid., p. 235, for an example in which the intraclass correlation technique 
leads to the inference that the r is negative when observation of the table, 
or calculation of the average intercorrelation among the columns or among 
the rows shows that the average intercorrelation of the classes is markedly 
positive. 
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CORRECTING A COEFFICIENT OF CORRELATION 
FOR ATTENUATION 

Virtually always in practice when we compute a coeflBicient of 
correlation between two arrays, we are correlating measures of 
imperfect reliability. To the extent to which our measures are. 
unreliable, our obtained correlation is too low; if there were no 
reliability at all in our measures of one or both of the traits, we 
would get a zero correlation no matter how highly the traits 
were really correlated intrinsically, i.e., if truly measured. We 
have a legitimate interest, therefore, in asking ourselves how much, 
higher the true correlation is than the one we have obtained from 
our fallible measures. To find this correction is to “correct 
our r for attenuation.” A formula for this purpose is easily 
derived after the manner employed in the second section of this 
chapter. Since we want the “true” correlation, we must have 
the correlation of the average scores from an all-but-infinite 
number of forms of each of the tests with which we are dealing. 
Making our starting point formula (111) in the first section of 
this chapter, we must therefore make both o and b infinite. As 
a preliminary step to doing this, we shall divide both numerator 
and denominator of the fraction by ob, and get 


raf.M, 



As a and b approach infinity, we shall have left 


'ruxTuv 


(Formula for a coefficient of correlation 
corrected for attenuation) 


The Tiix and the ru, are the reliability coefficients of the two 
tests, respectively. The f*# is the average correlation between 
any number of samples of measures of the x and the y functions. 
But in practice we ordinarily have in hand only one pair of sam- 
'ples, and we must take this as representing the r between the 
functions obtained with fallible measures. Therefore the r 
corrected for attenuation is merely the obtained r divided by 
the square root of the product of the reliability coefficients of the 
measures. This formula is applicable, of course, not only to 
tests of the objective, verbal type but to any sort of estimates or 
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other fallible measures. Sometimes this correction results in 
an r greater than 1.00. This is because the f^y obtained from our 
particular sample is not the one we would have obtained from the 
average of a considerable number of samples but is an abnormally 
high variant. It is the practice to write no corrected r’s as 
higher than 1.00 even though the correction gives mathematically 
a higher one. 


THE RELATION BETWEEN TRUE AND FALLIBLE SCORES 

This section merely extends the technique employed in the 
preceding one. For certain theoretical purposes we may wish 
to know certain relations between true and fallible scores (the 
latter being defined as the scores obtained from a relatively 
short instrument of measurement so that it yields results that 
vary somewhat from sample to sample and the former is defined 
as the scores yielded by an instrument applied an infinite number 
of times and the average taken so that the scores have been 
completely stabilized). We shall consider first the r between 
scores on a single sample of x measures and an infinite number 
of measurements of a 2/ function. This will give us the r between 
fallible scores and a true criterion. Making the general formula 
[Eq. (Ill)] our starting point, h is to be infinite and a is to equal 
1. Dividing numerator and denominator by 6, we have 






^/a + (a^ - a)Tux + ^1 - 0 ruy 


Substituting 1 for a and infinity for &, we have 




^af,J7eo "" 


VI + (1=* “ Vo + (1 - 0)ru„ 

(Correlation between a fallible 

and a true criterion) 


• xy 


( 122 ) 


The 7'1/s is the reliability coefficient of the instrument that is to 
constitute the infallible criterion — computed from fallible samples 
of it which we have in hand. The is the obtained correlation 
between fallible measures of the two correlated functions. In 
order to get the r between true scores and a fallible criterion, we 
would need only to make the proper interchanges in the formula. 
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We shall next take the case of correlation between a single 
sample and the average of an infinite number of samples of the 
same function. Here we proceed in the same manner as in 
the preceding paragraph; but the the tux^ and the ruy are 
the same sort of correlations (since the x series and the y series 
are similar measures of the same function), so that all the Ws 
of the formula will be ru. Then 


W.6/ = 


aru 


's/a + {a^ — a)rii. 

Substituting infinity for 6 and 1 for a, we have 




riz 




ru _ ru 

a/I ■Vni ~ aAv 


Reducing this by dividing the numerator by the denominator, 
we have 


(Index of reliability — the correlation 

^loo ~ V between fallible and true scores of (123) 

the same function) 

Thus the correlation between a set of fallible scores and a set 
of true scores of the same function is* the square root of the average 
intercorrelation among the samples, i.e,, the square root of the 
reliability coefficient of the test. This r between obtained scores 
and hypothetical true scores of a function is called the ind.ez 
of reliability in contrast with the coefficient of reliability of the 
test. It is claimed by many persons that such index of reliability 
is a fairer formula in terms of which to state the reliability of a 
measure than is the coefficient of reliability. 

Can we estimate an individuals true score from the fallible 
score we have in hand for him? We shall see* We have already 
learned how to estimate a score in a second series from a score in a 
first series, knowing the of the two and the coefficient of cor- 
relation between them. We make our estimate by means of the 
regression equation in score form, for which the formula was 
given on page 111. It is F ~ r»y(<ry/o'a)(Z' — M*) + My. 
For us the Y is to be the true score, cry the standard deviation 
of a set of true scores, the standard deviation of the sample we 
have in hand, and is to be ri^. Our formula then becomes 
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So far as we know is the same as ikf*. We, therefore, know 
everything required by our regression equation except o-J. 
We shall now find that. Taking the square root of both sides 
of formula (117) we get 

(Ts^ = c^i ^/ a + (a^ ““ a)ri/ 

This is the standard deviation of the sum of a sets of samples. 
We may get the standard deviation of the average of a samples 
by dividing the sum by a, remembering that we must make this 
when dividing under the radical sign. 

I -p r (Standard deviation of tho 

/I , 1\ average of a correlated 

cTs measurements of the same 

C \ a/ function) 

Now let a approach infinity. We shall then have, 

= <rt“\/0 + (1 — 0)rir 

(foo ~ (Standard deviation of a set of true scores) (124a) 

We are now ready to substitute in our regression equation. 

f ^ _ M,) + = ru(X - ilf.) + M, 

By a rearrangement of terma this may be written in a form that 
is more convenient for operative purposes as follows: 

(Formula for a true score in 

V « V _i_ /'I « ^ !iyf terms of a fallible score /i okn 

X = rjrX + (1 - ru)M^ the reliability ooeffi- 

cient of the test) 

What is the standard error involved in estimating a true score 
from a fallible criterion? We can easily determine. Our 
general formula for the standard error of estimate is 



We wish now to have y become a true measure instead of a fallible 
one. There are two cases: the first is the one in which we 
want the standard error of estimate of a true score from a 
fallible score of the same function. Here y is to be replaced by 
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so that we shall have 

~ ^loo 

From our preceding developments we know that = o-a-V^j 
that Ti^ = \/rH> and that, therefore, = ri/. Making these 
substitutions, we get. 


o-eat = o‘a.\/ru\/l — Ti/ (Standard error of estimate of 

*” a true score from a fallible 

o'eet* == o'x'V ri/ — r?/ score of the same fimction) 


(126) 


We can make the converse approach and get the scatter of 
the fallible scores in hand around the true scores. This is called 
the standard error of measurement and is used considerably in 
interpreting reliability coefldcients. Here x represents the true 
scores and y the fallible ones, and we have 


O’ (Meas ) 


= - rii 


(Standard error f-icyTS 
of measurement) 


P.E. is .6745ff. Therefore, employing the expression P.E.mom. 
for the probable error of a fallible score when estimated from a 
true criterion, 


P.E.(m»..) = .6745<rv/r^ (127a) 


where, again, ru is the reliability coefficient of the test and cr is 
the standard deviation of the sample in hand. 

The other case is where we wish to obtain the standard error 
of prediction of a true score in one function from a fallible score 
in another. The reader will be able to see, by proper substitu- 
tions in our basic formulas, that, when the x series and the y series 
are different, 


CTesty (Ty . 


TUy 


^1/v: 


Tiiy 


= (TyVriZv - rl 


(Standard error of estimate 
of a true score in one func- 
tion from a fallible score in 
another function) 


(128) 


Here the ru, is the reliability coefficient of the y measure taken 
from the samples of it we have in hand, the <r» is the standard 
deviation of the sample set of fallible measures, and the is 
the coefficient of correlation between fallible measures of the 
z function and fallible measures of the y function which we have 
in hand from our pair of samples. 
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The reader should take warning that the true scores about 
which we have been talking in these sections, the r’s between 
true scores, and the <r’s of true scores are to be taken as only 
hypothetical entities, useful for theoretical purposes. One is 
not justified in taking the theoretical true score calculated for a 
pupil to be necessarily his correct score. It is only that the aver- 
age of the true scores made by individuals who earned the same 
score on a fallible measure as that attained by him would be the 
true score estimated for him. His own might diverge widely 
from the estimated one. Neither should we substitute true 
sigmas for obtained ones in practical computations or use the 
"r corrected for attenuation” in applied regression equations or 
in the multiple or partial correlation problems we shall treat in 
our next chapter. 

CORRECTING A COEFFICIENT OF CORRELATION 
FOR HETEROGENEITY 

It is well known that, other things being equal, the size of a 
coefiicient of correlation is very much affected by the hetero- 
geneity of the population on which it is computed. Suppose we 
were to select 25 representative persons ranging from one year of 
age to twenty-four years and to compute a coefficient of correla- 
tion between their ages and weights. The r would be very high, 
perhaps .90 or .95. Suppose, now, we select twenty-five repre- 
sentative persons of ages approximately thirteen to fourteen 
years — say a random sample from the pupils of the eighth grade 
in school — and compute a coefficient of correlation between the 
ages and weights of this more homogeneous population. The 
r would be very low. The same contrast holds in other typos of 
data. When the coefficient of reliability of a test is given, it is 
important to know through what range of talent the test was 
given from which the r was computed. The same is true of a 
coefficient of correlation between intelligence test scores and 
scores on an academic achievement test, or an r between measures 
of any other two functions. To be comparable, two r’s must 
have been computed from populations of the same degree of 
heterogeneity or there must be some method of correcting one 
of the r’s so as to indicate what it would probably be if computed 
from the same type of population as that from which the one was 
derived with which it is being compared. ' 
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Kelley^ has developed a formula for correcting an r for a range 
of talent different from that of another with which it is to be com- 
pared; in other words, for inferring what an r would be in one 
range of talent knowing its size in another range of talent. We 
shall employ a somewhat different approach from his but arrive 
at the same result. We take first the case of reliability. 

Let a: be a score (in deviation form) in the narrow range and 
the corresponding true score. Then 


'Zx- 

N 


X — 

2Zxx, 


N 


x^ = d;x^ — 2xx^ 
Zxl _ Zd^ 2 


+ 


+ Xi - 


+ o'L = <^d 


Similarly, let X and Zoo be paired deviation scores in the wide 
range. Then, by the same process, if Z represent the standard 
deviation in the wide range and R the coefficient of correlation, 

- 2Rxx^ZxZx^ + 2L - 2^^ 

But, if the test is equally as effective in the narrow range as it 
is in the wide one, the distribution of differences between fallible 
and corresponding true scores will be the same in the two ranges,^ 
so that <rl will equal Z%, Therefore, 


— 2ra!Xca^aiO‘xoo + ^xoo ~ 2 |^ — 2Rxx„^x^x„ + 2 |-„ 


Substituting the values of r*®* and (Xxo, from formulas (123) 
and (124a), we have 


2'\/¥iiaafl'x\^Wi “f* == 2^ — 2\/R’uZxZx‘\/Rii + Z\Ru 

(xl - 2rucrl + olnt - 2| - 2i2x/S| + Z\Ru 


(Ta 1 ““ Ru 


- rxz) = 2^(1 - 2211 );^= 1 ^ 


<ya» 

Zx 


\/l — Ru 

Vi — ^1/ 


(Formula for correcting a reliability 
coefficient for heterogeneity) 


(129) 


From this formula it is easy to calculate either coefficient, know- 


^ Kbli<by, T. L., Statistical Method, The Macmillan Company, 1923, pp. 
221-223. 

* This is identical with Kelley^s assumption that the standard error of 
measurement is the same in both ranges. For the differences locate the 
items in the columns of the correlation surface, and, if the items that con- 
stitute the columns of the two surfaces are similarly placed, the variabilities 
of the columns under the two conditions will be the same. 
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ing the other and knowing the standard deviations in both the 
wide and the narrow range of talent. 

This formula relates only to the case of reliability. The 
development will not work through in nearly so simple a manner 
in the case of inter-function correlation. In the latter case, 
fl-tiRiiTniTig that the scatter (“variance”) of the distribution of 
true scores in the one function from their corresponding true 
scores in the other function is the same in the narrow range as 
it is in the broad one, we would have the following rather com- 
plicated formulas: 


(rormula for correcting intcr-funotion. f, on-, 
r’s for heterogeneity) 

But these formulas involve the reliability coefficients of the 
measurements in both functions for both ranges. Often, if not 
usually, information regarding these will not be available. But 
we can do well enough with the much simpler formula developed 
below, which works with obtained scores rather than with true 
scores. 

Let us assume that the standard errors of estimate are the 
same in the narrow range as in the wide one (see pages 112 to 
113). That is, 



'C' / / o / \ ^ 


ru, - {r%friu) 



Dividing through this equation by 



wo get 



(Approximate fomula for 
correcting inter-function (131) 
r’s for heterogeneity) 


These formulas demand no information regarding the relia- 
bilities, and we shall shortly show that they work well enough 
in practice. 

Kelley’s formula for correcting a coefficient of correlation for 
heterogeneity has been severely challenged. Holzinger^ gives 

^ HoiiZiitgbb, Ka.rl J., StaUst/icoA itfeffttxfs/or Studeni$ in Bducotiont Qihn 
and Clonipany, 1928, p. 254. 
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an illustration in which an r of .01 is increased to an R of .75 by 
doubling the size of the standard deviation and expresses doubt 
whether such an extreme change from merely doubling the varia- 
bility could be reasonably expected. Odell (though not in criti- 
cism) gives an illustration in which he infers a negative correlation 
for a narrow range from a positive one for a wider range of talent. 
But both of these examples are hypothetical cases, and neither is 
a case likely to be ever encountered in practice. There are, 
in fact, limits to the extent to which variabilities may change by 
merely extending the range from which scores are drawn, which 
limitation neither Holzinger nor Odell seems to recognize. The 
variability of the whole y distribution cannot become less than 
that of a single column of the correlation chart (assuming homo- 
scedasticity), for the y distribution must be made up of scores 
summe d across the columns . The standard deviation of a column 
is (Ty-y/l — If the R of the heterogeneous population is 
below .87, it is impossible for the o- of the homogeneous population 
to be as small as half the large sigma. The absurdities involved 
in certain hypothetical cases will be found to turn upon ignoring 
this limitation. 

However, in view of the challenge to Kelley’s formula, we 
subjected it to empirical test. R. S. Hovis^ secured evidence 
which indicates high validity for both formulas (129) and (131). 
One type of data he used was measurements of the relation of 
height and weight in children, based upon tables published in 
Biometrika from some Glasgow surveys. Ten different popula- 
tions were employed, each with ranges from four to eight years 
when massed into heterogeneous populations and with a range 
of a single year for the homogeneous populations. In the narrow 
ranges the populations ranged in number from 255 to 1,445 and 
averaged about 800. Since measures of height and weight have 
nearly perfect reliability, formula (130) would i^educe to (131). 
In 34 trials B’s predicted by formula (131) missed the corre- 
sponding ones actually computed from the consolidated tables by 
an average of only .0189 when the algebraic signs of the devia- 
tions were disregarded and by only +.0048 when the signs were 
considered. But formula (129) gave just as good a prediction; 

1 Hovis, R. S., “An Evaluation and Comparison of Two Ponnulae for 
Correcting Coefficients of Correlation for Heterogeneity,’’ master’s thesis, 
Fenn^lvania State College, 1935. 
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here the average error was .0172 when signs were disregarded 
and .0014 when signs were considered. , 

In a second study Hovis employed correlations between parts 
I and II of the Otis Classification Test (general intelligence and 
academic achievement), the homogeneous populations having a 
single grade range and the heterogeneous one a six-grade range. 
In these measurements the reliabilities were lower but still good. 
Out of 40 trials with formula (131) the predicted B missed the 
computed one by an average of .0129 when algebraic signs were 
disregarded and by .0097 when signs were considered. Formula 
(129) gave average errors of .0116 and .0065, respectively. 
Thus in both these studies these formulas for correcting r’s for 
heterogeneity proved highly valid, and formula (129) was as good 
as formula (131), even though formula (129) does not theoretically 
apply to inter-function correlation. 

REMOVING THE SPURIOUS ELEMENT IN CORRELATION DUE 
TO OVERLAPPING 

A student of one of the writers was attempting to fiAd the 
coefficient of correlation between college grades for a single year 
and those for other years. His data were in a form that gave 
the average nxunber of grade points earned by each student 
during the junior year and the average up to the end of this same 
year. In the grading system in question quality points of 0, 1, 
2, or p are given in each course; an average of these points for 
the year, obtained by multiplying the number of points awarded 
for a course by the number of “hours" in the course, summing 
for all courses of the year, and dividing by the aggregate number 
of hours carried during the year; and a similar point average 
computed “up-to-date.” Our student could not obtain the 
average of the two preceding years excluding the junior year 
without considerable extra work. When he correlated the junior 
year averages with those of the 3-year period including the junior 
year, his r was .92, which was obviously spuriously high. It was 
spuriously high on account of the fact that the array which was 
to be used as a criterion included the array which was to be 
correlated with it. How could he remove this spurious element 
due to overlapping and ascertain what would have been the r if 
the overlapping element could have been removed from the 
accumulated point averages before computing the coeffiicient of 
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correlation? We developed for this purpose a formula which 
applies to any sort of case where averages are employed and the 
criterion average includes the factor to be correlated with it. 
We shall use the following notation: 

X == accumulated point average for all three years 
y = point average 1 year less — to end of sophomore year 
z = point average for the junior year alone 
a = the number of years combined in x — ^in this case 3. 


For the sake of simplicity of development we shall take the Xj 
y, and z as deviations from the means of their respective series. 
It can easily be shown that, if the means of the constituent 
arrays are all equal, the relations among the deviations will be 
the same as the corresponding relations among the scores; and a 
little later we shall show that the effects of inequalities among 
means, too, cancel out in this problem, so that we commit no 
error by developing our formula in terms of deviations rather 
than in terms of scores. 

(a — 1) years were involved in making up the point averages 
of y. Therefore, for any particular student, 

_ yja - 1) + g 


Clearing of fractions, 


ax = y{a — 1) + « 

Multiplying through by a, 

axz = ya(a — 1) + z“ 

Summing for all students in the problem and dividing by their 
number, 


a 


Sa:a Syz , 

TT-TTf” 


l) + 


2a* 


The product moments can be reduced to r’s, as done repeatedly 
in this book, by multiplsdng both numerators and denominators 
of the fractions by the two required ff’s. Doing this, and using 
<7^ for 2aV*^> ■we have 

avafi^t — 1 ) + 
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We want a value for Transposing, and solving for this, we 
get 

r»*<r„(7s(a - 1) = ar«(r*<r* - (132) 

Roughly, we noight take the v’s to be equal, in which case our 
formula would reduce to = (or** — l)/(a — 1). But, in view 
of our showing in formula (124), the standard deviation of an 
average of correlated arrays is less than that of one of the com- 
ponent arrays and less than that of the average of a smaller 
number of arrays; to take the or’ a as equal would give us a pre- 
dicted r that would be somewhat too high. We shall do better, 
therefore, not to assume equality of <r’s in the formula even 
though we have reason to believe that the variabilities of the 
point averages are about the same in each year. We know, as a 
by-product from the calculation of r®*, the (r* and the a*. We do 
not know a-y, and to compute it directly would make us too much 
trouble, since we would need to make up a set of averages for the 
(o — 1) composite which is just what we are trying to avoid. 
But we can easily develop a formula for getting this standard 
deviation through elements we already know. In any one 
student’s case, ^ 

ax — z j , a-x^ — 2aa:s -1- s* 

S' = (. - 1)< 

Summing for all individuals and dividing by their number. 


V _ 

N ~ 

<4 = 

C-y = 


(a - ly 


a»Sa;® 

N 


_ Zxz , S?*" 


(a ^ 

1 / ‘n 0 rt 


(a - 1) 


2aT3:gdz(rz + A 


(Standard deviation of tho average of (a — 1) arrays 
in terms of the average of a arrays and 1 array) 


(133) 


We may now substitute this in formula (132) and have 

(Coefficient of correlation 
between the averages 
from (a — 1) arrays and 
1 array in terms of the 
averages from a arrays 
and 1 array) 


WTgtTioz — 


- 2ar^^n -f (7® 


( 134 ) 



INFERRING COEFFICIENTS OP CORRELATION 215 


We shall now correct for overlapping the spuriously high 
correlation found by our student. His r** was .92; <r* was .47; 
and <r* was .53. a was 3. Substituting these values in our 
formula we get, 


3 • .47 • .92 - .53 

V9 • .47* - 2 • 3 • .92 • .47 • .53 + .53* 


.811 


This same general type of problem often confronts the investi- 
gator when he wishes to determine the relative validities of 
different tests by correlating the scores of each with the average 
of all the others, or when he wishes to learn which of several 
judges is best by ascertaining which judge’s estimates correlate 
most highly with the average of all the others. It is much 
bother to make up each time a new average, omitting a different 
test or a different judge in turn. In order to save this labor, the 
same average of all is ordinarily kept for all the correlations, and 
each test or set of estimates is in turn correlated with this com- 
posite. But the r’s thus obtained are spuriously high, because 
of the element of overlapping due to the inclusion in the total 
of the scores to be correlated with it. We can remove this 
spurious element by the use of the formula developed above. 

But it will prove far easier to work with sums of scores than 
with averages, since an additional operation is required to 
reduce a sum to an average. A formula for sums instead of 
averages can be developed along the same lines, but more simply. 
We shall develop it in terms of scores rather than in terms of 
deviations, so as to fulfill our promise to show that inequality of 
means among the constituent arrays does not affect the formula. 


X = the score for an individual in the sum of all the arrays 
Y = the score of an individual in the sum of (jz — 1) arrays, 
the excluded one being the Z array 
Z = the score of an individual in the one array which we wish 
to correlate with the Y sum 
a = the whole number of arrays included in X 


Then, for any one individual, 

X = Y + Z 

Multiplying through by Z, 

XZ --YZ + 2® 
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Summing for all individuals and dividing by their number, 
{SXZ/N) = {I,YZ/N) + (S^ViV). We must now subtract 
from each term the correction required to make it conform to the 
formula for an r or for a v when taken in terms of scores rather 
than in terms of deviations. We may legitimately do this 
provided we compensatingly add these same terms. 



+ -M^- MJi, + + M\ 

* TyffTyiTz "H ^2 ”f" j^y^^z "1“ .iW* 

transposing and solving for 

_ ygzo'atr, — aj + (MzMz — MyMz — Ml) 


Before proceeding further we shall show that the M's in the 
parentheses aggregate zero. Since for each individual 

Y = X-Z, 

2F = SZ — "SZ, and therefore M„ = M* — Mi. Substituting 
this equivalent for the My in the parentheses, we get 

MxMz - (MzMx - Ml) - Ml = MxMz - MzMz 

+ Ml - Ml = 0. 

In view of the fact that the M's aggregate zero and cancel out, we 
have, upon canceling the vz from numerator and denominator, 

Tyz “ (riaCi “ v*)/<rj,. 

We must now find a value for o-y in terms of X and Z, as in our 
previous development. 

„ TiY^ _ SX“ 22XZ 


Adding and compensatingly subtracting the necessary quantities 
to make our terms it’s or r’s when the items are taken as scores 
rather than as deviations. 





2XZ MxMz \ 

NffyCTz CrxCTz / 

M? - 2M,M, + M* + M* 
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oj = (T* + (r| - - {Ml + 2M«M* -Ml- If*). 


Before proceeding further, we shall show that the Af’s in the 
parentheses aggregate zero. = ikf» — Jlf,. Substituting this 
in the parentheses, 


{Ml - 2MJi, + Ml + 2M,M, - Ml ^ Ml) = 0. 


We have left, therefore, as the value of <r„, 

(Standard deviation of the 
M ^ — 0^ ^ sum of (o - 1) arrays in 

V "T o^z ^^xzf^x<^z terms of the sum of a 

arrays and of 1 array) 

We may now substitute this value of o-y in the formula in which 
it occurs above and get as our completed formula 


^ tTg 

\/ol + <rl — 2rxza-xa-g 


(Coefficient of correlation between 
the sums from (a — 1) arrays and 
1 array in terms of the sums from 
a arrays and 1 array) 


(136) 


In the case of averages, with which this section opened, we 
would have experienced the same behavior as between scores 
and deviations that we did in the case of summed series; i.e., 
inequalities of means in the individual arrays would have 
canceled out leaving us the same formula when operating with 
items in score form as when operating in deviation form. None 
of the formulas involve any special assumptions. They can be 
counted upon to give the same r’s as would have been obtained 
by separating the arrays before computing the coefficient of 
correlation and are very convenient methods of correcting r’s 
for overlapping. 


SPURIOUS INDEX CORRELATION 
Another condition under which coefficients of correlation may 
be spuriously high is when each of the paired items is divided 
by a factor that is correlated with them. Thus, when we cor- 
relate IQ’s and EQ’s we have 

/M.A. E.A.\ 

^Vc.A. C.aJ 

Here both mental age and educational age are divided by 
chronological age. If C.A. were a constant the division would, 
of course, have no effect upon the correlation. But it is not a 
constant; it varies from pair to pair in a way that involves cor- 
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relation with the numerator of its fraction. This involves a 
community between the two arrays that appreciably affects the 
correlation. The remedy here is to compute the coefficient of 
correlation between M.A, and E.A. with C.A. held constant by 
the technique of partial correlation. This will be discussed in 
our next chapter. * 

A corresponding thing happens when AQ’s and IQ’s are 
correlated. Here the common factor, mental age, enters 
as numerator in one of the variables and denominator in the 
other. The effect is characteristically a negative correlation 
between intelligence quotient and educational quotient (see 
reference to Douglass and Huffaker at end of this chapter). 

Exercises 

1. Have the members of the class in which you are participating, or have 
at least three teachers, rate specimens of handwriting, or of sewing, or of art 
on one of the scales available for such purpose. Determine the reliability 
of the ratings. Calculate how many judges would be needed to give a 
reliability coelSicient of .97. 

2. Have the members of the class estimate the weights of one another and 
determine both the reliability and the validity of the estimates, 

8. In a similar spirit have persons give character ratings on classmates or 
on fraternity brothers, or have teachers rate their pupils on character traits, 
and ascertain the reliability of the ratings. Try different techniques for 
making these ratings specific and objective and ascertain effect upon 
reliability. 

4. In a particular situation the r between history scores and geography 
scores is found to be .78. The history test has a reliability coefHcient of .87 
and the geography test a reliability coefficient of .91. Correct the r between 
history and geography for attenuation. 

6. In a range of eight grades a certain intelligence test has a reliability 
coefficient of .98. What should it be expected to be for a single grade if the 
standard deviation for the eight grades combined is 32 and that for the single 
grade in question is 23? 

6. In Table IV, pages 58 to 61, compute the r between scores on 
English literature and total English scores (which include those on litera- 
ture). By means of formula (136) determine what the r should be between 
scores on literature and scores on the remainder of the test excluding litera- 
ture; remove the spurious effect of the overlapping. Finally, actually 
subtract the literature scores from the total, compute the correlation, and see 
how your r from the actual net scores compares with the inferred one. 
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CHAPTER VIII 


PARTIAL AND MULTIPLE CORRELATION 

The title to this chapter is likely to lead the reader to fear 
that he will find treated at this point a very complicated and a 
very mysterious topic. If he is already acquainted with the 
treatment of this matter in elementary texts in statistics, his 
experience there is likely to have confirmed this impression, 
especially in view of the rather forbidding-looking formulas that 
enter into the technique. But, in fact, partial regression and 
partial and multiple correlation are very simple in principle 
and parallel at every point simple regression and simple cor- 
relation as treated in Chap. IV. The reader should observe 
this parallelism as he progresses through the chapter. ‘ 

NATURE AND USE OF THE MULTIPLE REGRESSION EQUATION 

We may best approach the problem of the nature and use of 
the multiple regression equation through some illustrations. 
An agriculturalist wishes to predict from conditions that obtain 
up to the end of May what will most likely be the number of 
bushels of wheat produced per acre in July, This yield will be 
influenced by several known factors, such as, (1) the aggregate 
number of inches of rainfall through April and May, (2) the 
number of days of sunshine through these months, (3) the average 
temperature through these months. But these are not of equal 
importance as factors. In making his estimate, he must multiply 
each by an index number that will most closely accord with its 
relative degree of importance in affecting the yield of wheat. 
These several indices are the regression coefficients. 

Again, we wish to predict a student's grade in school from 
several factors known in advance. These factors are such as 
the following: (1) his intelligence score; (2) time spent in study; 
(3) health; (4) the socioeconomic status of the homo m which 
he lives. If we wish to predict his scholarship most closely, we 
may not give equal consideration to each of these factors, but 
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must multiply the scores on each by a coefficient growing out of 
its relative importance as a factor in producing the result in 
which we are interested. A critical problem becomes for us, 
then, the problem of ascertaining what are the relative degrees 
of importance with which the several components enter in the 
determination of the criterion; i.e., finding the several regression 
coefficients. Or we may merely wish to know the relative weights 
of the factors as an evidence of their relative importance. Many 
such problems confront the educational and social research 
worker, .such as: To what extent do stature, intelligence, quick- 
ness of decision, and breadth of scholarship contribute to leader- 
ship? In what relative degrees do hours spent in formal drill, in 
browsing, in listening to lectures, in going to movies contribute 
to one’s knowledge of history? And countless others. These 
relative weights are found by essentially the same procedure as 
the coefficients which are mentioned above. Or, perhaps, we 
may wish to put the matter in terms of coefficients of correlation 
because these are more familiar than regression coefficients. We 
shall then wish to 'find the extent of correlation between each 
of our several causative factors and our criterion when the influ- 
ence of the other factors is ruled out. These correlations which 
express what may be expected to be the relation between one of 
a team of factors and a criterion when the influence of the other 
members of the team is held constant, we call the coefficients of 
partial correlation. We shall see later that they are very closely 
akin to the regression coefficients and that they may be derived 
by essentially the same machinery. Perhaps we may wish to 
know what is the maximum accuracy with which we could predict 
a criterion by combining a number of predictive factors each 
with its “best weight”; how high a correlation, i.e., we could get 
in the case of our illustration between scholarship and our four 
contributing factors listed above taken jointly if we combined 
these in the best possible proportion. This maximum correlation 
that noay be expected from combining a team of factors is called 
the coefficient of multiple correlation. It may be derived directly 
from the regression coefficients. When, too, the technique of 
computing partial correlations can be made sufficiently simple to 
permit its use by the rank and file of research workers, we shall 
find it a feasible substitute for parallel-group experimentation 
where we caimot control certain disturbing variables in our* 
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experiment but can rule out their influence upon our findings by 
the partial correlation technique. It is clear, therefore, that, 
if we can get hold of the secret of finding partial regression 
coefl&cients, we shall have at our command an extremely useful 
tool in aU our research. 

DERIVATION OF THE FUNDAMENTAL “NORMAL EQUATIONS’* 

Our problem, you remember, is to find multipliers for a team 
of scores that will give each of the scores best weight in predicting 
(or producing) a criterion score. Let us put this in the form of 
an equation. Let us suppose that xo is the score of a particular 
student in scholarship (taken as a deviation from the mean of 
the scholarship scores rather than as a raw score), and Xi, x^, x^, 
and Xi are the same student’s scores on intelligence, socioeconomic 
status, health, and attendance, respectively. Then 
(.A) Xo — iiXi + hoXo d" bzXz + 2*43^4 

where the Vs are the coefficients by which we must multiply the 
several scores. We do not, of course, know the values of these 
•6’s; their values are just the very things we are seeking. But it 
is one of the beauties of algebra that it permits us to play with 
quantities, even if we do not yet know their numerical values; 
we merely designate them by letters and handle them as such until 
we can reach the point where we shall have found values for 
them. We know that there is some value by which we must 
multiply xi in order to give it its best weight, and also some value 
for each of the other coefficients, and we merely set 6’s for these 
values then proceed to search for the numerical equivalents for 
the h’a as our regression coefficients. 

But we have probably measured intelligence, socioeconomic 
status, health, and attendance in terms of different units, so that 
our ®’s in the different series are of unlike meaning. To carry 
them along in this way will cause unnecessary cumbersomeness. 
Let us, therefore, reduce all of our scores to “standard measures” 
which have everywhere the same meaning; we can easily return 
to ordinary scores when we wish. To get standard measures we 
merely divide each deviation score by the standard deviation of 
the array to which it belongs, We shall let a’s stand for the scores 
in standard measures. Then 

Xo Xi Xt , 

Zo = — > 2 i =5 — j Zo = — ; etc. 

(To (Ti 0*8 
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We shall also use iS's for the regression coefi&cients with standard 
measures instead of small 6's. Our equation then becomes 

Zo = filZi + ^ 2^2 + /Ss^s + ^4^4: 

In order to generalize our equation, we merely extend it out 
toward the right to any number of factors. 

(B) So = + ^2252 + /SsZs + • • • + finZn 

Now, if only we could apply some algebraic procedure to 
this equation, we might find the values of our several jS’s. But 
we are blocked by the fact that we have only one equation and 
in it a number of unknowns — all the /3's. We are helpless in 
this sort of situation until we have as many independent equa- 
tions as unknown quantities. Is there any way out? 

Yes, there is a way out, a way of getting as many equations 
as we need, but it involves a little calculus. 

We have drawn a little horizontal line above the Zo in the 
preceding equation. That is to indicate that it would be the 
value computed (estimated from the combination on the right). 
Each score thus estimated from the right side of the equation, 
when the jS's are so determined as to give the best prediction on 
the average, would miss the corresponding student^s actual score 
a little. The error in any one case would be Zo — zq. If we 
substitute for zoj its value from Eq. (J?), we have^ 

Zo — Zo ^ Zo — (/3iZi + / 32 Z 2 + PbZz + P 4 Z 4 + • • • + 

Now it is a principle of mathematics that for best fit the sum 
of the squares of the errors should be a minimum. We shall, 
therefore, square both sides of our equation and indicate by the 
summation sign that we have passed from considering a single 
score to the consideration of all the scores, because they all obey 
the same laws. Indicating the square on the left 'and squaring 
out the term on the right, we have 

- Soy = + plzl + ^Izl + Plzl + — • + 

— 2 ZoZiPi — 2Z0Z2P2 — 2 ZoZBfiz — ^ — 2 ZoZrfin 

+ 2ZiZzfilP2 + 2ZiZsPiPz + 2ZiZ4fiiP^ ^ ^ 2ZiZnPiPn 

+ 2z%Zz^2&z + 2Z2ZiP2p4 + 2Z2ZzfizpZ + • * ’ + 2Z2ZnP%fin + * ' ’ ) 

^ The procedure here is identical in character with that involved in the 
Peareon product-moment formula, p. 95. 
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Now, as was stated above, we want the values of the /3’s to be 
such that the right-hand member of our equation will be a mini- 
mum. We must, therefore, differentiate it and set its derivative 
equal to zero. But, since our equation contains a number of 
independent variables (the several fi’s), we must resort to partial 
differentiation, i.e., we must differentiate separately for each of 
the variables in turn. Differentiating first with respect to /3i 
(and remembering that every term will drop out of our derivative 
that does not contain a /3i), we have . 

S(2/3iSiSi — 2zoSi "h 2 / 32 Z 1 Z 2 -f- 2j33Zii?3 -J- -h * * * 

•+• 2^^iZn) = 0 

We shall now place the summation sign with each of the ele- 
ments within the parentheses, which is a legitimate way of sum- 
mating a complex quantity, and also divide through our equation 
by 2N. Then we have 




SziZi 

~ir 


SzflZi 

N 




SziZs 

N 


+ ^4 


TziZi 

~Tr 


+ fin 


22i2„ 

N 


= 0 


But remember that 2i equals aii/vi, 22 equals * 2 / 0 - 2 , etc. There- 
fore hziz^/N equals hxiXi/Na-Lffz. But this, it will be observed, 
is the formula for the Pearson r. For all such quantities in our 
equation we may, therefore, substitute r’s -with the proper sub- 
scripts. We shall then have (remembering that rn represents 
perfect self-correlation, which is equal to unity) 

j8i — roi -h -1- -f PiTxi +•••-!- j3„ri„ = 0 

We must next differentiate in the same way for each of the other 
/S’s. The result will be n equations similar in symmetry with the 
one above. Transposing the terms preceded by the minus sign, 
we have the following as our set of “normal equations”: 


^■01 = -f- + * 

ro2 = ^iJ’i2 -|- i32 -(- -1- + • 

*■0* = -4- i3« -4* ^4rs4 + -4" * 

j'04 = 4- + /3 jJ'34 + 184 -f- -h |8{J'4# -j- • 

Ton = PxTin + + PiTtn + ^iTu + 4" /3a>’6n 4“ 


4" PnTln 
4" ^nTin 
4" PnTzn 

+ j8»7-4» 

• 4-|8» 


Our concern from the first was to find values for our j8's. We 
have now found our way of doing so. We have as many equa- 
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tions in our set as we have independent variables. It is, there- 
fore, in principle, a very simple matter to solve these equations 
and find the values of our /3’s. All that there is to any special 
method of computing regression coefficients is some method of 
simplifying the solution of a set of simultaneous equations 
Practically every reader has solved such problems in high-school 
algebra, and you might be interested in trying on this set of 
equations the methods you have learned there, substituting 
numerical values, of course, for the r’s. But you will find the 
job extremely complex if you use more than two or three varisf- 
bles. The labor mounts rapidly with an increase in the number 
of equations and becomes enormous after four or five. 

THE MOST ECONOMICAL METHODS FOR COMPUTING 
REGRESSION COEFFICIENTS 

The principal trick in working with regression equations is to 
command some economical method of solving these equations. 
In the texts on statistics the method customarily explained 
involves doing in turn a series of partial sigmas and partial r’s, 
each time reducing the partials to a lower order by one. This is 
the method developed by Yule, which we may call the partial 
correlations method. But this process gets immensely complicated 
beyond three or four variables and also involves working with 
what for the layman are magical procedures the meaning of 
which he does not grasp. There is needed a simpler and more 
meaningful method. 

Various persons have devised schemes for reducing the labor 
involved in solving such sets of simultaneous equations. As 
early as 1865 Gauss developed a method of shortening the proc- 
ess by successive trials and approximations. The determinants 
treated in texts in college algebra afford a convenient method for 
solving simultaneous equations for those who are familiar with 
them. Within the past ten years Truman Kelley developed ar 
indirect method for attacking this particular problem of regres- 
sion coefficients which he called first the approximation methoc 
and later, in a further developed form, the iteration method. Bui 
these approximation methods are also difficult to learn and very 
baffling to lajunen. Peters and Wykes^ set forth a completed- 

1 PaTBBS and Wtebs, “Completed IDeterminants Method,'* J, Edue. Bes. 
Vol. 24, pp, 44-62. 
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determinants method making available to la 3 rmcn the method 
of determinants in a form that makes no demand that the 
worker know the algebra of determinants. 

The Doolittle method was developed by M. H. Doolittle, of 
the U.S. Coast and Geodetic Survey, about 1857. Up to this 
time but little attention has been given to it in texts on educa- 
tional statistics, although such books as those of Mills and of 
Ezekiel have presented it. For any considerable number of 
variables it is by far the best method available. We shall turn 
now to an explanation of it and to certain work sheets embodying 
it. The Doolittle method takes advantage of the fact that our 
set of equations is symmetrical to multiply each, as it is used, 
by such factor that, when the equations are added, certain terms 
at the left aggregate zero and are thus eliminated. In this way 
the number of terms is rapidly reduced to a single unknown, 
which can then be directly calculated. Thereafter the process 
must be reversed and substitutions progressively made until 
all of the unknowns have been found. In the following work 
sheets, set up by Mrs. Wykes, the procedure is indicated step 
by step. Our work sheet extends to ten variables, but beyond 
that number the student can make his own formulas by induction 
from the steps used up to ten variables. Evidence given in the 
series of articles, of which the one just referred to is the second, 
shows that the completed-determinants method is the most 
economical one up to four variables and that beyond that point 
the Doolittle method is by far the most economical. 

WORK SHEETS FOR THE DOOLITTLE METHOD 

The directions on the accompanying sheet are so explicit 
that no difficulty should be encountered in understanding them. 
An illustration will be given after the work sheet has been given 
and explained. It is to be noted that each row (line) has a 
number and each column a designating letter. These numbers 
and letters are used in the directions. 

The I found in the first row and column of each new section is 
considered in all calculations. It has been placed there perma- 
nently because that is always the value of the item in that place. 

The work sheet is prepared for calculations up to a ten- 
variable problem’. For any larger number of variables the reader 
can extend the work sheet by induction from the steps so far 
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Work Sheet for the Doolittle Method 


Lirectiona 

“Z1 


'IT 

nr 

T 

T- 

"Sr 

“B" 

T" 

"■"T“ 

X 

1 Insert values for r’s 

2 Divide line 1 by — 1 

1 

ria 

rxa 

ru 

ri8 

no 

ri7 

ri8 

rio 

— roi 

SA to 7 

3 Insert values for r’s 

4 Multiply items in line 1, B to I, by JSz 

5 Add algebraically lines 3 and 4 

6 Divide line 5 by negative Bs 

1 

raa 

ra* 

raa 

rao 

rar 

ras 

rag 

— ro2 

2B to 7 











7 Insert values for r's 

8 Multiply items in line 1, (7 to J, by Cs 

9 Multiply items in line 5, C to I, by Ca 

10 Add algebraically lines 7, 8, 9 

11 Divideline 10 by negative Cio 

“i" 

ra* 

raa 

raa 

rsT 

rss 

nV 

— ro8 

SC to 7 










12 Insert values for r's 

13 Multiplyitemsinline 1, D to J, by Ds 

14 Multiplyitemsinline 5, D to J, by Da 

15 Multiplyitemsinline 10, D to i, by Du 

16 Add algebraically lines 12, 13, 14, 15 

17 Divideline 16 by negative Di« 

1 

r45 

r48 

r47 

r« 

r49 

— ro4 

"z^toT 








' 

18 Insert values for r’s I 

19 Multiplyitems in line 1, E to 7, by Ba 

20 Multiplyitemsinline 5, E to 7, by Ba 

21 Multiplyitemsinline 10, B to 7, by Bn 

22 Multiplyitems inline 16, E to 7, by Bn 

23 Add algebraically lines 18, 19, 20, 21, 22 

24 Divideline 23 by negative Baa 

1 

rofl 

r67 

rss 

r69 

— ros 

SB to 7 








25 Insert values for r’s 

26 Multiply items in line 1, B to 7, by Ba 

27 Multiply items in line 5, B to 7, by B a 

28 Multiply items in line 10, B to 7, by Fit 

29 Multiplyitemsinline 16, B to 7, by Bit 

30 Multiplyitems in line 23, B to 7, by Ba* 

81 Add algebraically lines 25, 26, 27, 28, 29, 30 

32 Divideline 31 by negative Bai 

1 

roT 

rc8 

r#9 

— roo 

SB to 7 


_ 





33 Insert values for r’s 

34 Multiply items in line 1, <? to 7, by O 2 

35 Multiply items in line 5, 0 to 7, by <?« 

36 Multiplyitemsinline 10, 0 to 7, by On 

37 Multiplyitemsinline 16, (7 to 7, by <?i7 

38 Multiplyitemsinline 23, 0 to 7, by Ou 

39 Multiplyitemsinline 31, G to 7, by C?83 

40 Add algebraically lines 33, 34, 35, 36, 37, 38, 39 

41 Divide line 40 by negative G*© 


r78 

r7» 

— ror 







42 Insert values for r’s 

43 Multiply items m line 1, JET to 7, by Ba 

44 Multiply items in line 5, B to 7, by B* 

45 Multiply items in line 10, B to 7, by Bu 

46 Multiply items in line 16, B to 7, by Bit 

47 Multiply items in line 23, B to 7, by B 24 

48 Multiply items in line 31, B to 7, by Baa 

49 Multiply items in line 40, B to 7, by Bax 

50 Add algebraically lines 42, 43, 44, 45, 46, 47, 48, 49 

61 Divide line 60 by negative Bao 

T" 

rso 

1 

— ros 

SB to^ 





62 Insert values for r’s 

63 Multiply items in line 1, 7 to 7, by Ja 

54 Multiplyitemsinline 6, 7 to 7, by 7 « 

66 Multiplyitemsinline 10, r to f, by 7n 

66 Multiplyitemsinline 16, 7 to 7, by 7x7 

67 Multiplyitemsinline 23, 7 to 7, by 7a4 

68 Multiplyitemsinline 31, 7 to 7, by 7aa 

69 Multiplyitemsinline 40, 7 to 7, by 74i 

60 Multiplyitemsinline 60, 7 to7, by 7«x 

61 Add algebraically lines 62, 53, 64, 66, 66, 67, 68, 69, 60 

62 Divide line 61 by negative 78x 

1 

— ro9 

S7 to J 





coefficients, /3i, /Sbi 

■■lea 


. iSfc, 


e regression 



J^emaa + (0i)Gi% 4* _ 

MBu -f l§vGt* 4 I*! 

4MOu 4/- 




4 I« 






►I>a 4 


w-«;Ce 4 /* 

5a)Ca 4 (/5a)Ba 4 I* 
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presented. For anything less than a ten-variable problem, 
columns not needed should be cut off (marked out) beginning 
with the J column. Thus, work would be continued only through 
the H column for a nine-variable problem, through the G column 
for an eight variable, and so on. (The criterion is always counted 
as one of the variables.) In all cases, no matter what the number 
of variables, the I column is used. 

The lower sections also disappear in toto with a smaller number 
of variables than ten. They will disappear below that section 
where the column with your highest-numbered r subscript 
terminates in a 1. But this will not bother you; it will take care 
of itself. 

In the back solution, provided for at the foot of the work 
sheet, rows and colunms also disappear with a smaller number 
of variables. Beginning at the top of the set of back-solution 
equations, draw a line through each ^ on the left side of the equa- 
tions that has a subscript for which you have no corresponding 
r subscript. Extend this line all the way across, thus striking 
out the whole equation constituting that line. Then strike 
out all the columns that have had their respective Ps eliminated 
with the eliminated rows. The remaining elements are all 
that are needed in the back solution, discussed in our next 
paragraph. 

You need now only find the values of the several /3’s in these 
back-solution equations at the foot of the work sheet. They are 
the regression coefficients you are seeking, each corresponding 
with a similarly numbered element in your r's. The value of 
the topmost one is indicated directly in your equation; the others 
are obtained by successive substitutions in the equations that 
foUow. 

The X column in the work sheet is the check for correctness. 
Its use is optional, but, if it is not used, the problem should bo 
done simultaneously by two different workers and their results 
compared from time to time, or should be done by the same 
person twice on different work sheets, perfect consistency 
being required. 

The check is to be used as follows: the capital sigma is the 
summation sign, meaning that you should add together all the 
items in the line between the limits named, including the limits. 
The X column is to be included each time you are told to multiply, 
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add, or divide lines. But carefully note this exception: before 
multiplying any summated item in the X column by the factor 
used as a multiplier throughout the line, subtract from this 
summation all the items in that line lying to the left of the column 
with which the multiplications in that line started. For example, 
in line 14 you are told to ‘^multiply items in line 5, D to 7, by 
When you extend this multiplication into the X column you 
must first subtract from the value standing at X^ the values at Cs 
and Bs before multiplying the remainder by De, It amounts 
to the same thing to sum the line only from the column in which 
the multiplier is found, A corresponding thing must be done at 
lines 4, 8, 9, 13, and every other place where such a multiplication 
is called for.^ 

Before proceeding further, we shall do an example, since the 
directions for using the work sheets seem to be hard to follow 
before concrete illustration and easy to follow thereafter. We 
shall use a study by Miss Dessa E. Gresser on ''The Factors 
Conditioning Comprehension of Literature in the Senior High 
School.^’^ One finds some pupils who have diflElculty in compre- 
hending the literature they read. One feels at a loss to know 
what to do for them until one knows what are the factors that 
cause the failure to comprehend. Miss Gresser undertook 
to ascertain what some of these factors are and with what weight 
they severally contribute toward the ability to comprehend. 
It is to this sort of problem that the partial regression technique 
lends itself as a tool. 

The factors considered by Miss Gresser were 

1. Speed of reading. 

2. Knowledge of grammar. 

3. Range of general information. 

4. Knowledge of vocabulary. 

Each of these abilities was measured by suitable tests and scores 
on each obtained for each pupil used in the research. The 
criterion, ability to comprehend literature, was similarly meas- 

^The spacing in the work sheet on p. 227 is too small to permit operations 
on the page unless with a very sharp pencil. For a work sheet with wider 
spacing the worker should copy this one on a larger scale or send to the 
authors for copies. 

* A master's thesis at the Pennsylvania State College 1932. Abstracted 
in Penn, State Btvdiee in Educ, No. 8. 
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ured by the Stanford Test of Comprehension of Literature. 
The following zero-order correlations were obtained among these 
four factors and the criterion, for the last of which we use the 
subscript 0 and for the others the numbers indicated above. 

roi = .334 ri2 = .370 rzs = -642 rsi = .735 

ro2 = .416 ri3 = .396 r24 = .578 

ros = .653 ri4 = .567 
ro4 = .691 

We must now insert these values for the several r’s in the 
proper places in the work sheet and do what the work sheet 
says. The reader should carefully verify all the stops, then use 
this example as a model. In using the work sheet, (opposite page) 
we omit all parts we do not need for a problem of tliis length. 

The results we get at the foot of the work sheet are the partial 
regression coef&cients. What do they mean? They serve two 
sorts of purposes. One of these is to show us the relative weights 
of the four factors in contributing to ability to comprehend 
literature. These weights are speed of reading, —.0691; knowl- 
edge of grammar, —.0857; range of information, -I-.3530; and 
knowledge of vocabulary, -t-.5203. The first two are substan- 
tially equal to zero, so that we may say grammar (as measured 
by the Kirby test) and ability to read rapidly do not contribute 
significantly to ability to comprehend literature when these are 
separated from the force they get by overlapping general infor- 
mation and knowledge of vocabulary. The other two contribute 
heavily, vocabulary making a larger net contribution than general 
information. These weights are not to be confused with per- 
centages; they cannot be expected to add up to -t-1. They are 
the slopes of the respective regression lines relating the criterion 
with each of the factors in turn, when the influence of the other 
factors involved in the problem (but not additional disturbing 
factors) are hold constant and provided the factors are measured 
in units of equal variability. 

The second use is prediction of scores in the criterion from a 
knowledge of scores in each of the contributing factors. If we 
take our measures in z scores, we can predict the score a student 
is most likely to make in comprehension from his scores in the 
four other tests by the regression equation 

So = -.0691«i - .0867 z 2 + .3630z, + .5203*4 
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But it is only in those cases where we are dealing with scores 
that have the same variability in all distributions — ^like z scores, 


Doolittle Wobk Sheet 

Miss Gresser’s Data — Arranged for Obtaining ^ 04.123 


Directions 

B 

B 

C 

D 

I 

X 


■ 

ri2.370 


r 14 . 567 

-7-oa-.334 

+1.9990 


m 


-.396 

-.567 

+ .334 


3 Insert values for r's 

1 

r23 . 642 

7 * 24 . 578 

1 — 7*02 — . 416 

+1.8040 

4 Multiply items in line 






1 , B to J, by B 2 


-.1369 

- . 1466 

- 2098 

+ .12361 

-.3696 

5 Add algebraically lines 






3 and 4 


+ .8631 

+ .4956 

+ .3682 

-.2924| 

+1.4344 

6 Divide line 5 by nega- 






tive Bs 


-1 

-.5741 

-.4266 

+ .3388 

-1.6619 

7 Insert values for r^s 


1 

7 * 34.735 

— ro3 — .653 

+1.0820 

8 Multiply items in Hne 1, C to J, 



i 


by Ci 



-.1568 

-.2245 

I +.1323 

-.2490 

9 Multiply items in line 6, C to /, 



i 


by Co 



-.2845 

-.2114 

+ .1679 

-.3280 

10 Add algebraically lines 7, 8, 



1 


and 9 



+ .5587 

+ .2991 

-.3528 

+ .5050 

11 Divide line 10 by negative Cio 

-1 

-.5353 

+ .6315 

-.9039 

12 Insert values for r's 



1 

-ro4-.691 

+ .3090 

13 Multiply items in line 1, D to I, by D 2 1 

-.3215 

+ .1894 

-.1321 

14 Multiply items in line 5, D to I, by De 

-.1571 

+ .1247 

-.0323 

15 Multiply items in line 10, D to J, by Du 

- 1601 

+ .1889 

+ .0287 

16 Add algebraically lines 12, 13, 14, and 15 

+ .3613 

-.1880 

+ .1733 

17 Divide line 16 by negative Die 


-1 

+ .5203 

1 

-.4797 


Substitute values from above table for symbols in the following equations 
OS’s for each equation found when each variable in turn is solved for) and 
solve equations for the regression coefficients, |3i, Pi, ^s, and 184 . 


Pi = In = +.5203 

Pz = (PiKDn) +In = (.5203) (-.5353) + .6315 = +.3680 

Pt =• 034 ) (A) + (P,)(.Ci)+h = (.5203) (-.4266) + (.3530) (-.6741) 

+ .3388 => -.0857 

Px ~ 034 ) (D 2 ) + (PzXCz) + ((32) (S») +jr. = -.0691 

T scores, ranks, or percentiles — that our predicting equation 
remains so simple. If we have scores of unequal variabilities, we 
must take account of the sigmas. If our measures are in terms 
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of deviations from the means of their respective arrays, our 
regression equation would become 

Ho = ffo(- .0691 - - .0857 - + .3530 ^ + .5203 - ) 

\ <fl 0’2 O’S <TiJ 

If we wish to put this in terms of raw scores instead of deviar 
tions, we must substitute (Xi — Jlfi) for Xj., (Xi — Mi) for * 2 , 
etc. We shall then have, as our regression equation, 

Xo = (TO (- .0691 — - .0857 — + .3530 — + .5203 — M - K 

\ O '! ^2 0‘8 0*4 / 

where K is given by the following expression (which may be 
calculated once for all the scores) : 

K = <70 (- .0691 — - .0857 — + .3530 — + .5203 — ) - Mo 

\ O'! <’’2 <7S <7i / 

The Xo in this equation is the score predicted for an individual 
from the team at the right. Let us take the following hypo- 
thetical data from Miss Gresser’s study. A boy made the 
following scores; 

1. Speed of reading, 100. 

2. Grammar, 30. 

3. General information, 90. 

4 Vocabulary, 80. 

What score may he be expected to make in comprehension of 
literature? We shall take the means and the standard deviations 
of our several factors to be as follows: 



Mean 

Standard Deviation 

1. Reading * 

96 

30 

2, Grammar, 

36 

6 

3. Information 

96 

20 

4. Vocabulary 

92 

30 

0, Comprehension, * 

63 

22 



Putting these values in our score-form regression equation, we 
predict for this boy: 

Xo = 22(-.069W - .0857^ + .3530^^ -|- .5203^) 

- 22(-.0691M - .0857V -j- ,3630|^ .6203^) 

-1- 63 « 67.6 
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Thus for the boy in question we forecast a score of 57.6 in 
comprehension, which is 5.5 points below the average. 

In this particular problem the prediction function is not an 
important one; the value of the regression technique lies rather 
in its ability to show the relative weights of the contributing 
factors in explaining success in the comprehension of literature. 
But, if we wished to predict the probable academic success of a 
candidate for admission to college, so that we might select or 
reject him as a promising or unpromising candidate, or if as a 
basis for vocational guidance we wished to forecast the degree 
of a person's success in each of several vocations, the prediction 
function might become one of great importance. As a pre- 
liminary to the use of a regression equation for prediction 
purposes, we must, of course, have had previous measurements 
of success in the criterion and in each of the predicting factors, 
on the basis of which we have been able to compute the necessary 
correlations. Assuming that these r's will hold for future samples 
of the population, we employ measurements of certain factors 
we can get now as a basis for prophesying scores in a criterion 
that, for the particular individuals for whom we are attempting 
to forecast, can come into existence only in the future. 

So far in this discussion we have put our formulas in particular 
terms — ^in terms of the number of variables and the particular 
coeflSlcients of correlation in Miss Gresser's problem. We shall 
now state the formulas in general terms. First is the case in 
which we use z scores, or other types of scores of the same varia- 
bility in all our arrays: 


2 o — *4" ^o 2 U 34 --* 2 J 2 (Regression equation in 

+ * • • + terms of ^ scores) ( 137 ) 

Next we take the case where scores are worked in terms of deviar 
tions from the means of their respective arrays but the variabili- 
ties of the several arrays are different. This involves merely 
substituting z/cr, for z. 


Zo = cro 


Z% Z2 

^0l-284.-.;fc h ^02-184...* — 

Cl C2 


+ iSo* 


Zk\ 
• 128 .- — I 


(Partial regression 
equation in de- 
viation terms) 


( 138 ) 
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Finally we have the case where the several series are measured in 
terms of unequal variabilities and where we are wor ding -with 
raw scores. For this we replace a; by (Z — Mb). 


^0 = Vo 


/So 


1*234. 


0*0 I /3o1.234. 


Xl , . X2 

•ft r P02.134.-ft 

CTl (Tg* 

•Wi , . Mi 

-ft "T P02.134.-.ft 

P ‘1 <^2 


+ • • • + ^Oft-1234... 
+ • ' • + ^Oft.1234... 


+ Mo 


(Partial regression equation in 
terms of raw scores) 


(TkJ 

:?£.A 

V* J 

(139) 


PARTIAL CORRELATION 

When developing the formula for the Pearson product-moment 
coefficient of correlation (page 96), we had occasion to notice 
the relation between a coefficient of correlation and a regression 
coefficient. When b^v stands for the regression coefficient of x 
on y and stands for the coefficient of correlation between these 
two arrays, we saw that = 6*tf(v„/v*). The h, we said, is 
the slope of the line in terms of whatever units happen to be 
employed in measuring the z and the y, while the r is the slope 
of the line of regression relating the paired variables when the 
variabilities of the two arrays have been made equal. A precisely 
parallel thing is true of partial correlation. The partial regres- 
sion coefficient, which we learned above to find, is the slope of the 
line relating the paired measures in a criterion and some other 
factor when the influence of certain other factors has been ruled out 
but when our units of measurement are not necessarily of equal 
variability. However, corresponding to the case of the zero order 
r’s, the coefficient of partial correlation is defined as the slope of 
this regression line when the variabilities of the two arrays have 
been made equal.^ Consequently, employing jSoi.a to represent a 
partial regression coefficient of the second order, roi.a to represent 
the corresponding partial correlation coefficient, vo.ia (called the 

1 The reader must not be misled into thinking that, if we start with e 
scores or other units of equal variability as wo did in developing our paxtial 
regression formulas, we avoid this distinction by having only equal vari- 
abilities all the way along. As a matter of fact, whenever we partial out 
the influence of a factor, we (normally) lessen the variability of whatever 
we have left, and the amount of such reduction differs for Cerent factors. 
So that, when we arrive at the point at which we wish to deal with partial 
correlations, we have unequal variabilities regardless of the nature of the 
measurements with which we started. 
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partial standard deviation) to be the standard deviation of the 
criterion scores when the effects of the inclusion of factors 1 and 


Doolittle Woek Sheet 

Miss Gresser’s Data — Arranged for Obtaining 1840.123 


1 Insert values for 

1 

7*12. 370 

7*13 . 396 

r 14 . 334 

-r(,i-.567 

+1.5330 

r^s 







2 Divide line 1 by— 1 

-1 

-.370 

-.396 

-.334 

+ .567 

-1.5330 

3 Insert values for r^s 

1 

ris.642 

7*24.416 

— ro 2 — .578 

+1.4800 

4 Multiply items in line 






1 , B to 7, by Bi 


-.1369 

-.1465 

-.1236 


-.1972 

5 Add algebraically lines 






3 and 4 


+ .8631 

+ .4955 

+ .2924 

-.3682 

+1.2828 

6 Divide line 5 by nega- 






tive Bb 


-1 

-.5741 

-.3388 

+ .4266 

-1.4862 

7 Insert values for 


1 

r 3 4 . 653 

— 7*03— .735 

+ .9180 

8 Multiply items in line 1, C to 





I, by Ci 



-.1568 

-.1323 

+ .2245 

-.0645 

9 Multiply items in 

line 5, C to 





I, by Co 



-.2845 

-.1679 

+ .2114 

-.2409 

10 Add algebraically lines 7 , 8 and 





9 



+ .5587 

+ .3528 

- .2991 

+ .6126 

11 Divide line 10 by negative Cio 

-1 

-.6316 

+ .5353 

-1.0961 

12 Insert values for r's 



1 

— 7 * 04 — .691 

+ .3090 

13 Multiply items in line 1, D to 7, by D 2 

-.1115 

+ .1894 

+ .0778 

14 Multiply items in line 5, D to 7, by Do 

-.0991 

+ .1247 

+ .0257 

16 Multiply items in line 10, D to 7, by Du 

-.2228 

+ .1889 

-.0339 

16 Add algebraically lines 12, 13, 14, and 16 

+ .6666 

- 1880 

+ .3786 

17 Divide line 16 by negative Du 

-1 

+ .3318] 

-.6682 


Substitute values from above table for symbols in the following equations 
(i 8 ’s for each equation found when each variable in turn is solved forj, and 
solve equations for the regression coefficients, j3i, ^ 2 , ^ 8 , and ^ 4 . 


^ In = +.3318 (When working for ro 4 .i 28 , the only regression coeffi- 
»» ( 184 ) (Du) + III cient needed from this sheet is 

^2 i^i)(D6) + i^i){Ce) + 1 9 

i3l « 04)(D2) + (^3)(C2) + (^ 2 )m + I 2 

2 have been ruled out, and ai.os to be a similar standard deviation 
for factor 1, we have 
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and correspondingly, 


Txo*2 == ^ 10.2 


O’0»12 

O’l*02 


The roi .2 is precisely the same as the rio. 2 , since the former is 
the regression of factor 0 upon factor 1 and the latter the regres- 
sion of factor 1 on factor 0; and these are the same in the case of 
the r’s. But that is not true in the case of the j^^s. Let us now 
multiply these two equations together. We shall get the partial 
r squared, since the two of these have the same value. The 
fractions containing the partial sigmas cancel, since one is the 
reciprocal of the other. Hence, 


^01. 2 = ■\/^01«2 * ^10.2 (140) 

The general case is obviously similar. 


5^0A!-1234*.. 




0fc.l234‘ 




1234. 


(The partial correlation 
coefficient) 


(141) 


Thus the partial r may be obtained by taking the square root 
of the product of the two corresponding partial regression coeffi- 
cients. One of these, i3o4.i234..., we have already learned how 
to compute. The other differs from this only in having the 0 
and the h interchanged, where the 0 is the criterion factor and 
the k is any other factor in which we are at the moment inter- 
ested. Hence all we need to do is to interchange the position 
of these two variables in the work sheet, then find the new regres- 
sion coeflSicient in precisely the same manner as we did the original 
one. The easiest way in which to avoid confusion in this inter- 
change is to write out a table of new equivalents for the original 
correlations. Suppose, for example, you wish in a four-variable 
problem to shift factor 3 into the criterion place in exchange for 
factor 0. You must substitute a 0 for each 3 and a 3 for each 0. 


New roi = old ris 

r02 = Tiz 

Tqb = 7*03 

^18 — roi 

T2Z — To2 

Any correlations not containing 0 or 3 are unaflfected. Having 
substituted the new values for the coefficients, forget about it, 
and do just what the work sheet says, as before. The new j8 
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is found at the position in your work sheet exactly corresponding 
with that of the old one. Multiply this new (3 by the old one 
that stood at a corresponding position in the original work sheet, 
take the square root of the product, and you will have the required 
coefficient of partial correlation. Your radical will, of course, 
have the ambiguous sign, as all square roots do. Affix to the 
root the sign of the partial /3’s from which it was derived. Both 
of the jS's will always have the same sign if the work has been 
correctly done. This process must be repeated as many times 
as there are partial r’s to be determined. 

If only one partial r is required, as is often the case, give the 
factor involving it the highest number of the set, and thus place it 
in the column nearest the right of the work sheet (except, of 
course, the criterion). Then all except a very few of the calcula- 
tions will be the same as the one involved in the original work 
sheet and much labor will be saved. We are giving on an 
accompanying page a sample of the work. We have drawn 
double lines around the parts that involve new computations. 
If the reader will compare this work sheet with the one on which 
the partial regression coefficient for factor 4 in Miss Gresser's 
problem was computed, he will see that all the others reappear 
here in precisely the same form as there, but some of them in 
different positions. In order to show this, we have copied all 
the work but blocked in with heavy lines the only elements it 
would really be necessary to copy, for the sake of the new 
operations or for th e new check. 

The partial r is \/.5203 • .3318 = .416. This is the coefficient 
of correlation between knowledge of vocabulary and ability to 
comprehend literature when the factors of speed of reading, 
knowledge of grammar, and general information are held con- 
stant. It will be observed that the partial r does not differ 
very much from the partial jS. 

Let us again get in mind the meaning of partial regression and 
of partial correlation in order that we may raise the question 
of the value of knowing each. The partial r shows the slope 
of the line relating our factors when the influence of certain other 
factors is eliminated and the varicMliUes of the residual scores 
have been equalized as between the criterion and the factor being 
correlated with it. The partial j3 is the slope of this same line 
without equalization of the variabilities of the residual scores 
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but with equal initial variabilities. In other words, the standard 
deviations of the measures in terms of which we take our original 
measurements are equal in the case of the partial j3’s, but the 
partial standard deviations (which we shall discuss shortly) are 
not necessarily equal. It is here suggested that, since partial p’s 
are simpler in meaning than partial r’s, since they are easier to 
compute by our technique (although the reverse was true by 
the old Yule method), and since they are not likely to differ 
much from partial r’s, it would be preferable as a rule to make 
our showings in terms of partial P’s rather than in terms of 
partial r’s. We can take initial measurements in terms of equal 
standard deviations, but partial standard deviations exist 
only theoretically. To ask how factors as we can know them are 
related to one another when the overlapping elements have been 
removed seems to be more sensible and meaningful than to ask 
how they would be related if they could be measured in terms 
adjusted for a variability that is never concretely accessible but 
that can exist only in imagination. Nevertheless, in spite of 
the greater convenience of partial P’s, statistical workers will 
nfeed to make some use of partial r’s because people are more 
accustomed to thinking in terms of coefficients of correlation 
than in terms of regression coefficients. But when partial 
regression coefficients are announced as evidences of closeness 
of relation between criterion and factor, or as evidence of the 
relative amounts of such relation among the several factors, 
they should be p’s, not h’s; i.e., they should be the regression 
coefficients with variabilities equalized as these come from our 
work sheets. If they are otherwise announced, as is sometimes 
done, it is impossible for a reader to interpret them without sup- 
plementary information about the variabilities of the criterion 
and of the several related factors, and even then the interpreta- 
tion is rather awkward. 

MULTIPLE CORRELATION 

The coefficient of multiple correlation is the r to be expected 
between scares on our criterion and the scores predicted for the 
individuals by the partial regression equation. It is, thus, the r 
between the criterion as actually obtained and the criterion as 
predicted from the whole team of related factors, each multiplied 
by its regression coefficient. Since the regression coefficients 
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represent the best possible weights for prediction purposes, the 
multiple r is the highest r that could be obtained between the 
team on the one hand and the criterion on the other. For 
multiple correlation we customarily employ the capital U rather 
than the lower case r. A formula for multiple R is very easily 
developed. 

At the opening of this chapter we let Zo stand for such predicted 
score on the criterion and gave as its value 


2o = + 18323 + ■ ■ ' + 

where the subscripts are simply more abbreviated ways of 
indicating the partial j3’s than we used earlier in the chapter. 
Since all of these are in deviation form, and since the multiple B 
is, as said above, the coefficient of correlation between the 
calculated zo and the observed one, we have, as our formula for 
multiple correlation, 

_ SZqZq _ 2 Zo( 0 iZi + iSsZj + ^323 H~ • • • ~b ffngn) 

Multipl3dng through the equation by o-jocrj, and placing the N 
and the S20 with each of the terms instead of with the expression 
as a whole, we have 


„ i8iSZo2i , /32 SzoS 2 , jSaSzoZs , , |8„2ZoZ„ 

+ • • • + 

On the right we have formulas for Pzroi) etc. But the value 
on the left side of the equation demands examination, o-,, = 1, 
for it is the standard deviation of a full set of standard measures, 
and the standard deviation of any full set of standard measures 
is 1.^ The ffjo is not quite so simple. It is not the standard 
deviation of a full set of z scores but of the 20 scores that are 
calculated as lying on the regression line, We must find a value 
for such a standard deviation. We shall take fitrst the general 
case, in deviation form. 

^ This may be easily proved as follows: 

N “No® al, 


1 
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0*1/ 

y = T-^x 

O’® 

2 

7/^ 7*2 -y>2 

y T 

N <xl N 
_2 

(r% = 7*2 jy. ^2 7*2^2 

0*57 = 7*(rj, 

Thus the standard deviation of scores calculated as lying on a 
rectilinear regression line is r tinaes the standard deviation of 
the whole set of scores. When we parallel this with the case we 
want, we have 

<rg(, — HifXztt 

But ffjo = 1. Therefore vjo = S. Making in our last R equa- 
tion (above) all of these substitutions we get, 

= fiiVoi -f- fiiroi -f- ‘ + l^nfon 

Taking the square root and substituting again the more complete 
and conventional subscripts for the /S’s and for R, 

Remits.. .h — 's/^Ol.234...*iroi -|- ^02.184.--Jfc’’02 + ’ ’ ‘ + j3ofc.l234...rofc 

(Coefficient of multiple correlation) (142) 

Normal account must, of course, be taken of algebraic signs. 

When we apply this formula to the data of Miss Gresser’s 
problem, we find a multiple correlation coefficient of .73. The 
highest zero-order coefficient was .691. The multiple correla- 
tion coefficient is always higher than the highest zero-order one 
in the team, and the gain by using the multiple regression 
technique for purposes of prediction is indicated by the amount 
by which the multiple correlation is increased over the highest 
simple one. A multiple correlation of .73 means that, if measure- 
ments of a group were taken on the four factors related in the 
problem to comprehension of literature and composite scores 
made for pupils by multiplying’ their scores on the several tests 
by the optimum weights indicated by the partial regression 
coefficients, these scores would predict standings in compre- 
hension of literature with an accuracy represented by a coefficient 
of correlation of .73. 
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A problem where prediction, is relatively more important tTia.Ti 
it is in this problem of Miss Gresser’s is a small one done at 
Pennsylvania State College having to do with prediction of 
college success by a battery of objective tests given in high school. 
The Carnegie Foundation for the Advancement of Teaching 
gave to high-school seniors in Pennsylvania such a battery of 
tests. When these were worked up with grades in the freshman 
year of our School of Engineering as criterion, they showed the 
zero-order r’s and the partial /S’s set opposite them as follows: 


Variate 

r 


Mathematics 

.55 

.4383 

.4401 

.1127 

.2234 

Physical science 

.61 

American history 

.23 

Foreign language 

.44 

Otis intelligence test 

.40 

.0644 

English 

.28 

-.1632 



This battery yields, by application of our formula, a multiple 
correlation coefficient of .78. The reader may compare this 
again with the highest zero-order correlation and ask himself 
whether in attempting to predict college success it is worth while 
to make a battery of all these test factors rather than to predict 
by means of one of them. 

PARTIAL SIGMAS 

The reader will surely be impressed, as we proceed, with the 
complete parallelism between simple and partial correlation. 
All that we said on pages 110 to 123 by way of interpreting the 
meaning of a coefficient of correlation applies with equal force 
to partial and multiple correlation. The same is true of what we 
said in that chapter about prediction by means of the simple 
regression equation. We learned there that, when we preffict 
by means of a simple regression equation, we miss somewhat 
the actual scores we are attempting to predict. The standard 
deviation of these errors we called the stand ard error of estimate. 
The formula for its amount was <r«t, = A parallel 

thing is true of prediction by means of the partial regression 
equation^ Let us run through a development of a formula for 
this. Let Xo be an obtained score on the criterion and So be a 
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score for the same individual predicted from the team of factors, 
each with its best weight. Then in any particular case the error 
will be {xo — . We need the standard deviation of these errors. 

We shall treat them, as usual, in deviation form. 

_ 9 . _ S(a;o — XoY _ '^xl 22x0^0 . Sxg 

^ ^ N N 

_ StrJ 21^xqXq _ _ , Xxl 

~ N N 

= ~ 2J?cr*oaSo + ff|^ 

But we showed a few moments ago that <r^ = Making 

this substitution in the two places where the cg, occurs, we 
have 

= tfl, - 2Z2V|^ + 

= <(1 - 
^tets “ 1 ”■ 

Replacing the symbol on the left by one that is more conventional 
in this connection and using oxir more familiar symbol with the 
same meaning for the <r on the right, we have 

(Formula for partial 

sigma, the stand- 

O-0.12S4...J! = ffoVl — Ro-isu—h “d error of esti- (I43) 

mate m partial 
regression) 

This is the theoretical standard deviation of the scatter of 
the scores predicted by the team from the regression line. If 
the reader will hold in his mind’s eye a correlation chart, it is the 
measure of the scatter of the columns in such chart when the 
scores are all placed in the columns to which they properly belong 
as determined by all the other factors that make up the team. 
Whatever scatter still remains in these col u m n s is due to factors 
additional to the ones caught in the team; if all had been included, 
there would be no scatter in the columns and the R would be 
perfect. In the chart of simple (zero-order) correlation, too, 
the standard error of estimate is, as we previously saw, the 
standard deviation of the columns when the scores have been 
grouped homogeneously with respect to the criterion factor, 
i.e., of the y scores when they have been grouped into columns 
of like X values. This standard error of estimate in multiple 
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regression is called, as indicated above, the ■partial sigma. 
Analogously the standard error of estimate might have been 
called a partial sigma. Indeed it is sometimes written <ri.2 
and called a partial sigma of the first order while the <ri.2S4...« 
is called a partial sigma of the nth order. 


SOME COMPLETED FORMULAS 
For any large number of variables, formulas for partial cor- 
relation and for partial regression coefficients become extremely 
complicated. But it is convenient to have such formulas, 
couched in terms of only zero-order correlations, for three or 
four variable problems. Beyond that point the worker should 
employ the DooMttle work sheets provided earher in this chapter. 
The formulas given'below might readily have been worked out 
with these work sheets, using general terms instead of arithmetical 
quantities, so that no new principles would be involved. As a 
matter of convenience, however, they were worked out by the 
method of determinants, which is another method of solving 
sets of simultaneous equations.^ 


POBMTJLAS FOE RbGEBSSION COEFFICIENTS 


i3oi.23 = 
fios-ia = 
Pm- 12 = 


j3oi.2 = 


roi — ro2ri2. 


1 - rh ' ~ 1 - rf2 

roi(l — ria) — ro2(ri2 — ri 3 r- 23 ) + ro 3 (ri 2 r 23 — ria) 
(1 — ris) — ria(7-i2 — risfas) + ^^(riaras — ru) 
>•02(1 — rfa) — roi(ri2 — risraa) — rmjrm — ri^n) 
(1 — — ri2iri2 — runz) - 1 - ruirnrn — rjs ) 

roi(ri 2 r 28 — rn) — rpiiris — riaria) + rpaCl — rj^) 
(1 - ris) - ri2(ri2 - rwraa) + risiri^a — rw) 


ro2 — roiri2 


(144) 

(145) 
(145a) 
(1455) 


Formulas foe Partial Coeeblation Coefficients 


roi.ss 


_ rpi - ro2ri2 

V(1 - * 02)^ (1 - ’"la) 

^ _ ^02 ^0 1^*12 

\/(l - ^Ol)\/(l - ^?2) 

roi(l - ria) - ro 2 (ri 2 — riaraa) + ro 8 (n 2 r 2 » — ria) 

V2ro 2ro8r28 + 1 - rga - rgg - rfa 

\/l — »2s - ?‘i2(j'i2 — ri8r23) + risCriargg — rig) 


(146) 
(146o) 

(147) 


^ Such formulas for problems up to five variables are given in an article 
by Peters and Wykes in the /. Educ. Res,, VoL 24, pp. 44-52 (June, 1931) * 
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7*02»1S 

^ roit(l - rfa) - roi(ri2 - n^js) - ro3(?’23 - riaria) 

•\/2ro iro3ri3 + 1 — ^oi — rga — rfg 

Vl — ^23 — ?’i2(ri2 — riiTis) + ri3(ri2r23 — rjs) 

5^03*12 

_ roi(ri2r23 — r^) — — riaris) + ro3(l — 

V2roi ro2ri2 + 1 - Vpi — rgg — rfg 

Vl — ds — ri2(j-i2 — Ti^m) + ritirura — ns) 


(147a) 


(1476) 


Rbliabilitt Formulas 


The reliability formulas for partial and multiple correlation 
are closely parallel to those for zero-order r’s and 6’s and are 
interpreted and applied in precisely the same manner. The 
standard errors are given below. The P.E. is in each case, of 
course, equal to .6745 times the standard error. ^ 


<rT„ 


1 ^01.234-. -It 

Vn 


_ yi — 

vnvi - jg!.234::r„ 

_ V(1 — JRo.123-.-)(1 — |9oi.23...|3l0.23...) 

.0234*.. 

— ■ <ro*vl — jRo>123««- 

- VFviVr- .R5.234... 




I — Ru .i 234 ...n 


(148) 

(149) 


(160) 

(151) 


Possibilities and Precautions 
Under proper conditions the partial regression technique 
is a very valuable tool of research. It has been employed 
extensively in agricultural research and in psychological and 
educational investigations. It has especially promising possibili- 
ties as a tool for research in sociology and economics. The partial 
correlation technique can be made a substitute for controlled 
experimentation, in addition to the two uses discussed earlier in 
this chapter. In controlled experimentation we make two 

1 For small samples N should be replaced by (W — a), where a is the num- 
ber of arrays intercorrelated (including the criterion), when the i is to be 
used with Student’s distribution for testing the hypothesis that the true 
regression or correlation coefficient may be zero. 
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groups — an experimental and a control — equivalent by selection, 
then apply an experimental factor to the former group while 
withholding it from the latter. Thus we are enabled to learn 
how, when all other pertinent conditions are held constant by 
selection and manipulation, the experimental factor is related to 
certain measured outcomes which we use as a criterion of success. 
In partial correlation we hold all of a set of factors except one 
constant in order that we may determine the relation between 
this one and a criterion, but we hold the disturbing ones constant 
by statistical analysis rather than by actual selection and 
manipulation. There are many situations, especially in social 
science research, where we are not at liberty actually to manipu- 
late the conditions; we must accept them as they come, with all 
their entanglements. Here the disturbing factors may be held 
constant by the partial correlation technique, and thus the 
equivalent of a controlled experiment may become feasible. 
The effect of high tariffs on imports, for example, cannot, under 
present notions of the function of governments, be studied by a 
scientifically controlled experiment, but it might be investigated 
by the partial-correlation method. 

But some precautions must be noted regarding this technique. 
Partial correlations are notoriously affected by errors in measure- 
ment. The final values of the partials turn upon small differ- 
entials in the zero-order r’s, especially as the number of variables 
increases. It is, therefore, very important that the validity 
and the reliability of the basic r’s be high, and the more so if 
the number of variables is considerable. Hence to justify the 
application of this technique to problems of more than three or 
four variables, the number of cases upon which the r’s are based 
must be large. The formulas as we have given them assume, 
too, rectilinearity of regression between all the correlated arrays. 
It is possible to have corresponding formulas for curvilinear 
regressions, but the formulas would be necessarily very complex. 
Under certain circumstances it might be feasible to translate raw 
scores that involve curvilinear relations into new ones between 
which the regressions would be rectilinear, then compute partial 
r’s in terms of these transmuted scores. 

Exercises 

1. la 1919 six objective tests were administered to 900 freshmen entering 
the engineering school of Purdue University. The purpose was to ascertain 
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wliicli test individually and what combination of tests would best predict 
college success as indicated by grades made in the freshman year. The 
following correlations resulted. Calculate the ‘"weight” with which each 
should be entered -in the team, and the multiple i2. Find the partial r of 
intelligence with scholarship and all standard errors. 



Fresh- 

man 

scholar- 

ship 

Arith- 

metic 

Alge- 

bra 

Geom- 

etry 

Intelli- 

gence 

Physics 

Tech. 

infor- 

mation 

Arithmetic .... 

.51 



.54 

.45 

.55 

.58 

.46 

Algebra 

.46 

.54 

— 

.38 

.38 

.38 

.24 

Geometry 

.374 

.45 

.38 

— 

.22 

.43 

.45 

Physics 

Technical infor- 

.39 

,58 

.38 

.43 

.28 


.41 

mation 

.293 

.46 

.24 

.45 

.34 

.41 

— 

Intelligence — 

.343 

.55 

.38 

.22 

— 

.28 

34 


2. The following table of intercorrelations was taken from an article in 
The School Review for March, 1924. The number of pupils involved in the 
study was 213. Compute from it the weights of the several relevant factors 
in predicting success in algebra (you to decide which ones are relevant), the 
multiple jK, and the reliabilities of the statistics you calculate. 



Achieve- 

ment 

test 

scores 

Kuhl- 

man 

intelli- 

gence 

Ter- 
man ! 
intelli- 
gence 

Trait 

ratings 

Teacher 
ratings 
on apti- 
tude 

Lee 

algebra 

apti- 

tude 

Teacher's marks 

.538 

.481 

.437 

.599 

.593 

.459 

Achievement-test 







scores 


.559 

.472 

.388 

.531 

.624 

Kuhlman intelligence. . 



.834 

.359 

.440 

,690 

Terman intelligence. . . 




.287 

.341 

.564 

Trait ratings 





.525 

.286 

Teacher ratings on apti- 







tude 






.474 


3. By the partial regression technique determine the weight of each of the 
factors in Table IV in predicting final grade-point average. 

4. Determine the multiple correlation between the team of factors 
involved in Exercise 3 and final grade-point average. 

6. Compute the partial r between at least one of the tests of Exercise 3 and 
final grade-point average. 
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CHAPTER IX 

MULTIPLE-FACTOR ANALYSIS 
TETRAD-DIFFERENCE TECHNIQUE 

Under the leadership of Spearman there was developed, 
comparatively recently, a technique for investigating the 
presence of a general factor running through three or more sets 
of variables. The usual combination is of four variables, hence 
the name tetrad differences; though the technique may be extended 
into pentads or into combinations involving an even larger 
number of variables. Spearman^s original purpose was to 
investigate a hypothesis that ^'intelligence^^ may bo explained 
by a common g factor plus a number of specific factors. But tho 
tetrad difierence technique may be utilized in a variety of research 
situations additional to the one for which it was first employed. 

Since this technique has to do with the presence of a factor 
common to different sets of variables and hence with an element 
of overlapping among the factors, it is most natural to take 
our point of departure for the development of tho formulas from 
our treatment of correlation as percentage of overlapping between 
the correlated variables, page 121. On that page we saw that 
if two variables, x and y, have in them a common factor, c, while 
the other elements of the two are unique rather than common, 
then 



This may be separated into two factors, so that we may write 

<r. 

In this connection it will be more convenient for us to employ 
numerical subscripts rather than literal ones and also to use a 
simpler symbol for each expression of the form, cr<,/<r». Let us, 
therefore, write 
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CTc <^e 

7*12 aia2 

CTl <T2 


where ai stands for o-o/o-i and for Oc/vz. 

Suppose, now, we have not only two variables to which the 
element c is common but four. Then all four of these are inter- 
correlated through the common element, c, so that 



<r c 

0*0 

O'c 

a, 

= — ■ 

• — == aia^; T 2 z = 


• — =: a20iz 

O'! 

<^2 


<rz 


(Tc 

(Te 

O'c 

^13 

' — = aiaz] r24 == 


— = azoii 

O’! 

<TZ 

0-2 

Oi 


(Tc 

ffc 

Oc 

5^14 = — ■ 

• — = aia^; r34 == 


‘ — = ^30:4 

O'! 

cr4 


04 


We may now combine certain of these equations by multiplies^ 
tion so as to make the resulting products equal to the same thing 
in all the combinations. 

= aiazazcti ruras = cna2(xzai = aiazocson 

If, now, we subtract in pairs and designate our tetrads by the 
symbols indicated below, we have 


ii234 = Tisrzi — riarn = 0 (152) 

ii243 == ri2r34 — ri4r23 = 0 (152a) 

tisiz = ri3r24 — J'i4r23 = 0 (1526) 

Three additional tetrads could be made, but the other three 
would be only these with the signs reversed, so that it is unneces- 
sary for us to write them here. 

It is thus seen that, if a common element c runs through all 
of four sets of variables, the differences between certain pairs 
of products of the r’s is zero. Consequently, when we find such 
differences to be zero, that finding indicates the presence of such 
general factor. While this converse proposition does not follow 
from our proof, Spearman^ gives a proof that it, is true. It is 
important to note that all the intercorrelations must be deter- 
mined solely by the common element c. There may not be 
between any pair of elements of the tetrad any further common 
element than c or the r involved wUl be hi^er than the presence 

^ SFEABmuT, C., The AiUities of Man, The MaomiUaii Company, 1927, 
Appendb;, pp. iii-Ti. (This proposition has, however, been challenged.) 
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of the c alone would explain; and, wherever the two elements 
occur between which there is a higher correlation than that 
'mediated by the c, the product will be raised or lowered in value 
so that it will no longer equal that of the correlations paired 
with it in the tetrad. Our development assumes, then, that the 
factors are entirely uncorrelated except through the common 
element c. 

Spearman approaches the tetrad formulas through partial 
correlations and arrives at the same result as we gave in our 
three tetrads above. ^ Since his development is short, wo shall 
reproduce it here, with changes in terminology, by way of further 
confirmation. 

Let ri 2 .c denote the correlation between factors 1 and 2 if the 
influence of the common factor were eliminated. Then, accord- 
ing to our formula, page 243, 


= y*12 — TicT^c 

Vl - ^IcVl - ic 

But we are assuming, as said above, that c constitutes all the 
elements common to factors 1 and 2, so that 1 and 2 are uncor- 
related except through c. Therefore ria.c equals zero. Hence 


/ IZ — / lc» Zc r\ 

~ 7r~~T ' rr ■ -a- “ Oj ^12 ~ = Oj = rioTjo 

VI - J-LV 1 - Ac 

Going through the same sort of process for rn.e, rti.c, rn.c, rn-c, 

Tu-c, we get 

ri8 = ricTsc; rzs = rn = 

Tu = ru - 

We may now combine these equations in pairs by division and 
have 

Tit TicTto Ttc Tu rSoJ’.o ?*3c 

Since both fractions at the extreme left in the above sets are equal 
to the same thing, they are equal to each other. Hence 

— - “ — ; TxiTu = rwraij and rwrj* — risrji = 0 


‘ Ibid^ Appendix, p. iii 
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By bringing in, in this manner, all the combinations permitted, 
we would arrive at precisely the same set of tetrads as concluded 
our first development. It is, then, established that, following 
the proposition by Spearman cited above, if the indicated 
tetrad differences equal zero, there is an element common to 
aU four of the factors. But these differences would be precisely 
zero only in the rarest of instances — only when we had an unusual 
stroke of luck or when our measures were perfectly reliable. 
Because of errors of measurement these differences will deviate 
from zero even when there is present a common factor, and our 
only concern must be whether they deviate more from zero than 
the chance involved in fluctuations from sampling would explain. 
Hence we need a formula for the P.E. of a tetrad difference. 
Although it would be feasible to compute P.E.’s for each tetrad 
separately, that procedure is scarcely practicable since the 
number of tetrads involved in most practical applications is 
likely to be of considerable size. To meet this situation, Spear- 
man proposes the following formula for the average P.E. from a 
set of tetrad differences:^ 




(Average probable error of a 
set of tetrad differences) 


(153) 


where f denotes the mean of all the intercorrelations, s is the 
standard deviation of all the r’s from their mean, and 


22 = 3f 


n — 4 
n — 2 


n — 2 


the n being the number of variables intercorrelated while N is 
the number of individuals in the population. In order to 
refute the hypothesis that the true tetrad may be zero, an 
obtained tetrad should be at least four times its P.E. 

In the previous edition of this book we carried the treatment of 
tetrad differences further, deriving formulas for the probable 
error and for the correlation of the common factor with each 
of the constituent tests and giving an illustration of the use and 
interpretation of this technique. We are curtailing the treat- 
ment here and referring the interested reader to this earlier 

i Ihid,, Appendix, p. xi. 
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edition and to such more specialized books as Kelley’s Crossroads 
in the Mind of Man and Spearman’s Abilities of Man, because 
the tetrad-difference technique is now being largely superseded 
in this country by the multiple-factor analysis technique, which 
is more generalized. But the tetrad-difference technique still 
has a limited field of usefulness. The first factor loadings in the 
factor-analysis method are (before rotation”) exactly the same 
in value as the r’s between the common factor and the several 
tests in the Spearman tetrad-difference technique. However, 
the generalized multiple-factor method does not impose the 
restriction of no correlation except through the common factor, 
and it has a much more eflicient way of finding and evaluating 
additional group factors. 

THE NATURE OP MULTIPLE-FACTOR ANALYSIS 

Within the past few years several methods of multiple-factor 
analysis have been developed which give substantially equivalent 
results. Of these the two major alternative ones are those by 
L. L. Thurstone and Harold Hotelling. Both Burt and Tryon 
have developed rather major variations on these methods, and 
there have been a host of minor variations. In fact the technique 
of multiple-factor analysis is still (1940) so much in the making 
that it is not feasible to foresee into what form it will ultimately 
settle. There is also still some skepticism regarding the ultimate 
value of the present methods of multiple-factor analysivS in prac- 
tical research, although all who have worked with them have 
found them fascinating in theory and in mathematical manipula- 
tion. Nevertheless, the technique has enlisted widespread 
interest and extensive use in research. 

We could not possibly take the space in this book to explain all 
or even the major methods of multiple-factor analysis. The 
interested reader will need to follow them through the original 
expositions by their authors, or through more comprehensive 
secondary accounts (see references at end of chapter). Of these 
latter, Thomson’s The Factorial Analysis of Human Abilities is at 
present the most comprehensive single-volume account, and it is 
readable and authoritative. 

Of all the methods Thurstone’s centroid method is at present 
the most widely known and the most extensively used. We shall, 
since we must choose only one, confine out exposition to it. 
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Thurstone^s exposition of this method is carried in terms of 
matrix algebra and the geometry of hyperspace, and its reading 
is beyond the ability of a layman in mathematics and difficult 
even for those of fair mathematical training^ But, fortu- 
nately, for every geometrical argument there is possible a parallel 
analytic (algebraic) argument; and we have succeeded in develop- 
ing exactly the same argument in a very simple algebraic form. 
For the satisfaction of those who have read Thurstone’s presen- 
tation, we shall show the parallelism of the two derivations in 
footnotes, so far as our argument proceeds. We do not go into 
all the ramifications reported by Thurstone, by any means; but 
for every one of them that is couched in geometrical form there is a 
parallel and equally cogent analytical form. It is only the deriva- 
tion of the formulas in our presentation that differs from Thurs- 
tone’s; the arithmetic is exactly the same; and, of course, the 
outcomes are the same. We shall take this occasion to say, how- 
ever, that, if the reader wishes to be at home in the Hterature 
of mathematical statistics, he must learn the geometry of hyper- 
space because so many of the fundamental developments in 
statistics are couched in terms of it. 

What is multiple-factor analysis? When we measure such a 
trait as ^'general intelligence,’^ we may not be measuring a uni- 
tary attribute. It is conceivable that we are catching in the 
measured trait a component of reading ability, another com- 
ponent of ability to visualize geometric forms, of ability to see 
relations, etc. It is likely that different tests of what is supposed 
to be this same function will measure each of these constituent 
factors with different degrees of effectiveness (validity). Mul- 
tiple-factor analysis attempts to determine how many such 
independent factors are needed to account for our scores as 
revealed by their behaviors in a set of intercorrelations from a 
number of tests which are alleged to be tests of the same func- 
tion and to determine how heavily each of the tests is weighted 
with each of these factors, A basic consideration to keep in 
mind is that these factors are to be uncorrelated with one another 
(because otherwise they would not be independent) and that 
we wish to account for the test scores with the smallest possible 
number of factors and hence wish to take out on each successive 
trial the maximum possible load. 

^ Thtjkstoot, lu L., The Vedore of Mindf Umversity of Chicago Press^ 
1935. 
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THE BASIC EQUATIONS 

Let 1 and 2 stand for two different abilities possessed by an 
individual, and let Zi and Zi be standard scores indicating the 
true amount of these abilities possessed by him. Let aj and oj 
be the corresponding weightings (percentages of perfect validity) 
with which test a measures these abilities. Then, if Z is the 
individual’s standard score on the test as a whole, 

(A) Za = aiZi + ajza 

And for a second test, 6, 

( 5 ) Zb = hiZi + 6222 

Multiplying (A) by (J 5 ), 

ZaZb = UibiZi + 02622! + O162Z1Z2 + UihiZiZi 

Summing for the whole population and dividing by N, 

Z'ZaZb _ ^ T 22f , , Ssf , _ ^ ZZiZi , ^ SZiZ2 

— UlOl + O2O2 + 0261 — Jyi r O162 ' jy 


The value on the left of the equation is r^, because the mean of 
the paired products of z scores is the coefficient of correlation. 
"Zz^/N is the variance (o-^) of a set of z scores, hence equal to 1. 
Furthermore, the two abilities are uncorrelated, by hypothesis, so 
that Zziz^/N, which is the coefficient of correlation between 
them, equals zero. Therefore 

Tab — Ctlbl + O262 + 0 + 0 

If there were more tests, 

Taa = aiCi + ascn; m = bidi + 62^2; etc. 

Square Eq. (A), sum, and divide by iV, and observe that the 
variances are 1 and that the abilities are unoorrelated. 


+ a^z\ + 2ai02«i82 
ZZl aZzl . 2 Z 4 . „ 


ZZiZ2 

N 


of + 0^ = 1 


If there is an error factor and a specific factor, uncorrelated 
with the others, denoted by e and s, respectively, 
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a? + al + + a® = 1 

af + oi = 1 - (a^ + aj) = 1 ~ aj = A 2 

the communality of the test. The reliability coefficient of the 
test would be exactly the same as the communality except for 
specific factors. By reason of these the reliability is likely to be 
a little higher than the communality, but at any rate the com- 
munality has the reliability coefficient as its upper limit. 

Finding the Fibst Factoe Loadings 

We wish now to find the values for the factor loadings on the 
several tests. That is, we wish to find values for ai, a 2 , 6 i, and 
62 . Moreover, we want to account for the test scores with the 
smallest number of factors that is possible. Hence we wish 
to take out each time the maximum loading for each factor 
isolated. In order to extend our problem a little further than 
above and yet keep within convenient limits, let us assume 
three abilities and up to k tests. These may be laid out and 
summed as below. 

k will stand for any test, hi will be any test loading in 
factor 1 , kz any loading in factor 2 , etc. Sfci will be the sum 
of the factor loadings in all the tests combined in respect to 
factor 1 , etc. 

Taa ~ CLlCll G 2 CI 2 + ClzdB 
= dibi + <1262 "t“ d^bs 

TgJe = djki -j- ( 12^2 d^z 
Srofc = di^ki + di^ki + dzLkz 

Doing a similar thing for the correlations of each other test with 
all the other tests, then summing for these partial sums, and let- 
ting SJr be SSrAift, and therefore the sum of all the intercorrelations, 

(C) ^Tah = di^kx d" d2^k2 + dz^kz 

^Tbk ~ bi^ki "h hz^k^ 4“ bz^kz 
Srfefe = fciSJki + k2^k2 + kzl^kz 
Sr = 'Zki'Zki + Sfc22fc2 + l^kz'Sikz 
Sr = ^+S^+S3k? 

Now comes the crux of our development. We want Sfci to be a 
maximum. Therefore and must equal zero, because if 
either differed from zero by any amount, whether positive or 
negative, the value when squared would be positive and hence 
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would reduce the value of hkl and violate our assumption that 

"^1 is to be a maximum.^ Therefore 

(D) ' 2*? = Sr, and 'Ski = V^r 

From (C) it follows that aiSki = Srdk, because the two other 
terms in equation (C) must be zero for the reason given above. 
Substituting from (D), 


Similarly, 


Oi \/Sr = Sraij Oi = 


Srot 

\/Sr 


6i = 


Sru 

VTr 


etc. 


(164) 


We have now reached the climax of our development and are 
ready to apply our technique to a concrete problem and to find 
numerical values for the first factor loading. In Table XIV are 


Table XIV. — Intbrcorrblations among the Ten Tests 
(Sometimes Called the Correlational Matrix) 



a 

6 

c 

d 

e 

/ 

0 

h 

i 


a 

(.834) 

.544 


.488 

.545 

.642 

.834 

.716 

.463 

.366 

b 

.544 

(.544) 

.282 

.293 

.320 

.362 

.473 

.460 

.272 

.101 

c 

.500 

.282 

(.529) 

.483 

,381 

.438 

.408 

.629 

.369 

.301 

d 

.488 

.293 

.483 

mmmt 

.671 

.648 

.663 

.656 

.308 

.332 

e 

.545 

.320 

.381 

.671 



.608 

.595 

.305 

.344 

f 

.642 

.352 

.488 

.648 


(.729) 


.729 

.419 

.269 

0 

.834 

.473 

.498 

.563 

,668 

.703 

(.834) 

.723 

.507 

.364 

h 

.715 

.450 

,529 


.595 

.729 

.723 

(.729) 

,621 

.467 

i 

.453 

.272 

.369 

.368 

.306 

.419 

.607 

.621 

(.621) 

.393 

3 

.366 

.101 

.301 

.332 

.344 

.269 

.364 

.457 

,393 

(.467) 


6.921 

3.631 


6,068 

wmm 

6.651 


6.204 

4.’’378 

3.384 

kt 

.842 

.617 

H 

.719 

■ 

.790 


.882 

.623 

.481 


2r - 49.427; - 7.030433; - 0.1422387 

V2r 


displayed intercorrelations among ten tests designated by the 
first ten letters of the alphabet. In the conventional literature 
such a table is called the correlatioml matrix; but it is nothing 
but a systematic arrangement of the correlations of every test 

1 This is the first departure of our derivation from Thurstone’s. Making 
a maximum is identical in principle with the fact that passing the axis 
through the centroid necessarily makes the projections on axis I a maximum 
and the projections on the other axes a minimum. 
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in the series with every other test. Thus Tab is .644, r/d is .648, 
etc. The formula we just derived, (154), states that we must add 
all the r^s in the first column for Dro*, all in the second column 
for Dn*, etc. Those sums are entered in the row labeled 
in the table. Formula (154) also says that we must get the first 
factor loading in test a, (ui), by dividing by the square root 
of the sum of all the intercorrelations in the table. This sum is 
49.427 and its square root is 7.030433. But it will be easier to 
multiply by the reciprocal of 7.030433 than to divide by the 
number itself. The reciprocal is 0.1422387. Multiplying 2,rah 
(which is 5.921) by this we get .842. That is the weighting of 
factor 1 in test a. Sinoilarly, multiplying in turn the summa- 
tion at the foot of each colunm by 0.1422387, we get the weight- 
ings of factor 1 in each of the nine other tests, as shown in the 
last row of the table. 

Examination of Table XIV will show certain correlations 
enclosed in parentheses, the ones constituting the diagonal of the 
matrix. They are the estimated communalities, referred to earlier 
in this chapter. In a full set of intercorrelations there would 
appear such values as Taa, Ua etc. These would be the self-corre- 
lations of the tests in respect to the factors common to the tests 
which still remain. But they are seldom known. Even if we had 
reports on the reliabilities of the tests, these reliability coefficients 
would not be exactly the same as the communalities wanted, 
because the reliability coefficients would be raised above the 
communalities by reason of the presence of a factor specific 
to the several pairs of tests in addition to those factors common 
to all the tests. Thus the communality is a little lower than the 
reliability coefficient. It is also true that any inter-function cor- 
relation is somewhat lower than the reliabilities of the correlated 
tests, except for chance fluctuation. So the highest inter-func- 
tion correlation is not a bad guess at the communality. Hence, 
following Thurstone, we hunt in column a of Table XIV the 
highest r in the column and write it in the diagonal as the com- 
munaHty. For taa that is .834. We do likewise in each of the 
other columns in the table. 

Finding a Second Factor 

In the development with which we opened this section, we 
had equations of the type 
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Tab — Clibi -f- (I2&2 “ 1 “ 0363 

We know tke values of ra,, of ai, and of 61 , because we were 
given the former and have just found the latter two. Transpos- 
ing so as to get these known values on one side of the equation, 
we have 

0262 + aibi = ra> — aibi (156) 

That is, if there are in the measures any other common factors 
than 1 , there will be certain residuals in the correlations after 
factor 1 has been removed. These residuals are found in the 
manner indicated by Eq. (155). In this particular case the 
residual remaining as a^bi + 0363 would be found by substituting 
the value of Toj, and the obtained values of Ui and bi. 

Tab-i = .644 - (.842)(.517) = -|-.109 

The residual we write in the proper space to represent Tab in 
the table of first residuals. Table XV. But instead of writing 
its sign directly by the r value, we shall enter it at the top of 
the cell space directly at the left of it. That is done because we 
shall later wish to make some changes in these temporary signs. 
Similarly 

Taa-i = .500 - (.842) (.612) = -.015 
r,a.i = .483 - (.612)(.719) = -1-.043 

and so on with all the others. Wo enter all of these in the table 
headed First Residuals in the cells immediately to the left of 
the respective residusLls (Table XV). This process includes the 
residual communalities, entered in the diagonal in parentheses. 

Now we wish to isolate from this table of residuals a second 
common factor. The argument is precisely the same as it was 
in the case of factor 1 , so that we should be able to employ a 
second time the same technique. We proceed, therefore, to add 
our successive columns of r’s as we added the columns of Table 
XIV. But a strange thing happens^ all sums come out zero, or 
practically so. Some further algebraic manipulation would show 
us that all these sums must be zero if our arithmetic has been 
correct. Of course, not only would the sums of the separate 
columns be zero but the sum of all the intercorrelations would 
be zero, since this latter sum is obtained by summing the column 
totals. Thus, when we attempt to get our second factor load- 
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ings, each of them will be 0/0. This is an indeterminate expres- 
sion. and will get us nowhere. We must try some scheme of 
avoiding this pitfall. 

In this dilemma Thurstone has proposed that we change the 
signs of some of the tests. Any test score may be either positive 
or negative according to the way in which it is oriented. If, 
for example, a positive score means “tactful,” the same score 
with the negative sign would mean “tactless.” It is, therefore, 
entirely legitimate to imagine all scores on the test reversed in 
sign, so far as the remaining factors are concerned. ‘ The fact 
that we could not in practice reverse the part of the score that 
remains after taking out of it factor 1 need not bother us, because 
we are making the change merely conceptually and shall return 
to the original sign when our purpose has been met. To change 
the sign of all scores in one of the arrays will change tho sign of 
its correlation with every other array. We shall change the signs 
of such tests as will let us take out of our correlations at the 
next attempt the largest possible loading. There are several 
methods of doing this, but we shall choose that one of Thurstone’s 
proposals which gives unique results; i.e., one that could bo 
followed in precisely the same manner by persons working 
entirely independently. 

We shall sum the residuals (Table XV) algebraically by 
columns, not indvMng the communalities, entering the sums in 
row 2_o. After all the columns have been thus summed, we 
shall find the one having the highest negative sum,® In this 
trial that is test b. We mark Xi above that column to help 

* Our changing some of the signs in the first and second residuals is identi- 
cal with Thurstone's procedure. But, whereas in a geometrical system one 
must think of reflecting the test vector from one hemisphere to tho opposite 
one, we merely think what would happen algebraically if wo changed the 
signs of all the items of one of the variables when computing an. r between it 
and another. 

• In the geometric system one passes the axis through the most dense 
cluster of points, “ If an observer were stationed at the origin and ho could 
see in space of (r - 1) dimensions, he would discover clustering of the 
points if a second factor is conspicuously present . . , We want the second 
axis to go in that direction.” (Thurstone, A Simplified Method, pp. 4r-6). 
The precise equivalent in our system is the choice of the column that aggre- 
gates arithmetically large r’s. For arithmetically high correlations make a 
clustering of points, since the correlations are expressed by the cosines of the 
angles between the direction vectors, and large cosines moan small angles. 
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US remember that we chose it first for ^'reflection.^^ We now 
reflect'^ (change all signs in) test 6, entering the new signs 
just below the original ones in the narrow column at the left. 
But, having changed the signs of the r^s involving b in the column, 
we must, of course, change them also in row 6, indicating that 
fact by an Xi after the 6. Now we again sum our columns, dis- 
regarding communalities, and get a new row of sums, In 

that row the greatest negative value is in the column for test a. 
So we change the signs of all correlations in column a and in row 
a, indicating by an that we have done so. After summing 
again, we reflect test g. Upon summing after that change, we 
find that all the signs are positive. We are now through with 
the process of reflection as far as this table is concerned. 

But before we proceed further, we shall look to our commxmali- 
ties. In fact it would have been better to do this before reflecting 
any signs, just as soon as we had tested the correctness of our 
arithmetic by finding that the columns sum to zero. We enclose 
in parentheses the communalities we brought over from the 
previous table to show that we shall have no further use for 
them. The argument about what our communalities shall be 
in this table is exactly the same as that advanced in connection 
with Table XIV. So here again we take as our communality 
in a column the highest inter-function correlation in that column, 
entering it in the diagonal with positive sign. All communalities 
must be positive in sign because they are self-correlations, no 
matter whether the inter-function correlations from which they 
were inferred were positive or negative. It would not really 
be wrong to use the residual communalities standing in paren- 
theses. If our guess about the communality in Table XIV had 
been correct, the residual would be correct. But, since our first 
estimate was merely a guess, we choose not to trust it very far 
but make a new estimate by taking for the communality the 
highest inter-function residual in the column. 

With these changes in signs and in communalities completed, 
we place our final signs in front of the residual correlations 
and proceed to find a second set of weightings by exactly the 
same technique as we employed before in getting factor 1 load- 
ings. These stand in the row labeled feg. But they are the 
values with some reversed signs. In order to get back to the 
values actually used in the tests, we must reverse the signs for 
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all those tests for which we changed signs to get them. That is, 
we must reverse the signs of the obtained factor loadings for tests 
a, b, and g. The corrected loadings are given in the last row 
of the table. 

Finding a Third Factor 

Our argument continues to recur in the same form. We left 
off above with 

Tab-l — + a^z 

Transposing 

0363 = — asba (156) 

That is, there may still remain in our correlations certain resid- 
uals, owing to a remaining factor or factors. We know ra>.i, as, 
and 62, from Table XV, so that we can find the residual by 
exactly the same technique as we used in getting the first residuals, 

— ^06.1 ~ 0262 == .109 — (-f-.359)(-l-.373) = —.025 

We write this in the proper place in the table of second residuals 
(Table XVI). Notice that we use the final signs in the r’s, even 
if some are reversed as compared with their original values, and 
the ^2 values before the last correction in the factor loadings. 
But we must keep track of the number of reversals of each test 
so that we may ultimately restore the original signs. Continuing 
the process started for the one cell just above, we get the remain- 
der of the residuals for our Table XVI entirely analogously to 
the manner in which we got the first residuals for Table XV. 
Then we test our arithmetic by summing the columns, algebraic 
signs considered and communalities included. If the arithmetic 
is correct, all columns will sum to zero, or practically so. If not, 
we must discover the error before proceeding further. We 
then proceed just as in Table XV with the reflection of tests, 
achieving all positive signs after five reflections. Of course, if it 
appeared clear that we could not reach all positive signs, we 
would stop reflecting when we had attained that goal as nearly 
as feasible. Then, if not before, we put in new communalities 
and get the kz and the ks, rows of loadings in the same manner as 
in Table XV. 



Table XVI* — Second Residuals 
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We can continue to do this through as many factors as we 
wish, until our residuals are so small that they are obviously 
due to chance. 

TRANSFORMING THE VALUES 
(Equivalent to Rotating the Axes) 

Now we collect all our weightings so far determined into a 
summary table — ^Table XVII. (Pay no attention now to the 
numbers in parentheses; we shall refer to these later.) The 
columns appear to belong to two different systems; all weightings 
in factor 1 have positive signs, but about half of the entries in 
factors 2 and 3 have negative signs. It may be possible to make 
the three factors more comparable by transforming all of them 
to the same sort of system, having the same zero point. As a 
matter of fact there is no unique solution to a multiple-factor 
problem; an infinite number of different values would satisfy 
the fmdamental equations if only these values maintain the 
right relations inter se. So, in order to have a unique solution, 
let us impose the condition that all the weightings shall be 
positive (so far as possible) and that the number of zero loadings 
shall be ma ximi zed. We can control this last condition at least 
to the extent that each column except one shall have at least one 
zero and (if a positive manifold is possible) that its loadings shall 
run from zero up. But we mxist, of course, keep our two basic 
types of equations intact as to total value. If the primed 
symbols represent new values, it must remain true that 

0^1 -|“ o^hi -h Oj&s “ fli&i "b cisbt -|- Oshs 

because each of these must equal Tab, which' has a fixed value. 
Also 

fli® + Os® + aj* = af + = Afas 

because these are the communalities, and they have fixed values 
which may not be changed capriciously. Of course, the cor- 
responding equations must hold for the other tests. But we may 
diift values within the equations, provided the values of the 
equations as wholes are kept intact. (This is Thurstone’s prin- 
ciple of rotation of axes.) But to attack the problem of trans- 
forming all factor loadings at once gets us into complicated 
algebra. So we shall hold one factor constant while we manipu- 
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late the other two, then hold one of the first pair constant while 
we manipulate the left over one paired with one of the prior 
factors. (This is Thurstone’s principle of rotating about one 
axis at a time.)^ Taking the first two factors while holding 
factor 3 constant, 

a'l* + = a? + ai = 

Let <4 equal 0. Then 

+ 0 = al + <4 = A®i 2 
Hence oi = h^i^- Again 

"t” — Otibi -f" Oihi 

Since <4 = 0, 

a(6i = Oibi + fflzba; and hence b( = 

Oi 

We could now get new values for oj, Oj, and 6J, since all the 
required values in these equations are known. For any other 
required new loadings we could get new values by constructing 
similar equations involving them. 

Although we could use the above types of formula for getting 
a set of transformed values, we can simplify them further for 
computational purposes by a little algebraic manipulation. 
Reproducing them in generalized form, where k may stand for any 
test and m may stand for the test with the lowest factor loading 
in the independent function when corrected for uniqueness (i.e., 
when the loading has been divided by the square root of the 
communality, i.e., when divided by h^), we have 

1 , _mjci + mtki 

im 

The mi, ms, and mi will recur in the computation for each row, 
so we may as well make the required divisions once for the whole 
set of tests. Letting mi/mi be represented by mio and ms/mi 
by mso, {E) becomes 

Ibi = mioJki + (157) 

1 For a new scheme by which several rotations can be made simultaneously 
see L, L. Thurstone, “A New Rotational Method in Factor Analysis," 
Psychome^ha, Vol. 3, pp. 199-218 (1938). 
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Tor fcg we draw in addition upon the following two propositions: 

(F) ml + ml = A^i 2 - Since — 0, mi = 

Hence dividing formula (F) by mi^, 

(G) m?o + wfo = 1 

(H) kl + kl = hl^ 

Multiply ((?) by (H), then subtract formula (157) squared, 


mfofci + ml^kl + mfo7c| + miofcl = 

mfofcf + 2miom2ofci7c2 + m|ofc| = k[^ 

mlokl — 2miom2o7ciJc2 + miofcf = - k[^) = 


Taking square root, 

¥2 = miofc2 — m.2ofci (158) 

Formulas (157), and (158) are the ones we use for getting the 
new weighting in the rotated system.^ 

We shall make a numerical application of these formulas to 
the transformation of values in factors 1 and 2, columns headed 
1 and 2 in Table XVII, substituting for k the several tests in 
succession and letting factor 1 be the dependent one and factor 2 
the independent one. We want the values in factor 2 to be so 
transformed that they will extend from zero up in the plus 
direction. 

Test 6 has the lowest negative loading in factor 2 when cor- 
rected for uniqueness, i.e., when divided by Consequently, 

1 Our algebraic system of transforming loadings is identical in outcome 
with Thurstone's rotation in hyperspace. Ordinarily the rotating must 
be done about one axis at a time. Parallel to this, we transform two columns 
at a time. Guilford (p. 489) quotes from Thurstone the following formulas 
for computing new loadings, and the bases for these formulas are laid in 
Thiirstone's Vectors, pp. 203-205: 

kl' » kl cos ^ + fca sin 
^ 2 ' ks cos ^ — fci sin 0 

where 0 is the angle of rotation. If the reader will visualize, or actually 
construct, a plotting of the tests on a plane for two reference vectors, will 
rotate the axes so as to make axis I pass through the test with the lowest 
negative loading, m, he will find that is cos <f> and that mzQ is sin <f>. 
With these substitutions our formulas become identical with those of 
Thurstone’s rotational system. 
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let it be m. 

h'i = 0, by hypothesis. Hence hi = V2>x + bi = = -1-.638 

hi .517 oil j — .373 _Q_ 

= Fi = 

For each new factor 1 loading we shall need to multiply the 
original factor loading by mio, which is +.811, and add to that 


Table XVII. — Factor Loadings before Rotation 
(Starting Factor Loadings in Parentheses) 



1 

2 

3 


a 

+ .842 (.8) 

-.359 (.3) 

+ .079 (.1) 

.844 (.74) 

6 

+ .517 (.7) 

-.373 (.0) 

-.124 (.1) 

.422 (.50) 

c 

+ .612 (.3) 

+ .027 (.3) 

+ .043 (.3) 

.377 (.27) 

d 

+ .719 (.3) 

+ .261 (.4) 

-.237 (.6) 

.641 (.61) 

e 

+ .702 (.6) 

+ .103 (.4) 

-.233 (.3) 

.558 (.50) 

f 

+ .790 (.6) 

+ .063 (.3) 

-.244 (.5) 

.688 ( 70) 

0 

+ .863 (.7) 

-.248 (.4) 

+ .050 (.3) 

.809 ( 74) 

h 

+ .882 (.7) 

+ .142 (.5) 

+ .067 (.3) 

.803 (.83) 

i 

+ .623 (.4) 

+ .086 (.5) 

+ .267 < 0) 

.467 (.41) 

3 

+ .481 (.2) 

+ .213 (.6) 

+ .314 (.0) 

.375 (.40) 


the product of the corresponding factor 2 loading by mao, which 
is —.585; add these products algebraically. For this purpose 
it is convenient to write +.811 beneath the factor 1 column 
and —.585 beneath the factor 2 column, where reference can 
be easily made to them. For the new factor 2 loadings each 
original loading in factor 2 must be multiplied by mio and from 
that must be subtracted the product of mao and the correspond- 
ing original factor 1 loading. For this purpose it is most con- 
venient to write, under column 1, mao with reversed sign, (+.585); 
and, under column 2, mio (+.811); then add the products alge- 
braically as before. We shall illustrate a few of these sums of 
products. 

0,1 — mioffli + maoOs — (.811) (.842) + (—.585) (—.359) = .893 
ci = m,oCi + maoca = (.811)(.612) + (-.585) (+.027) = .481 
a'i = mioOa - maoai = (.811) (-.359) - (-.585) (.842) = .201 
cj = mioca - maoci = (.811)(+.027) - (-.685)(.612) = .380 

After thus transforming the loadings of factors 1 and 2 with 
factor 3 held constant, we proceed in the same manner to trans- 
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form loadings in factors 3 and 1 with factor 2 held constant. 
The results of these transformations are shown in Tables XVII, 


Table XVIII. — Factor Loadings after One Rotation 



1 

2 

3 


a 

+ .893 

+ .201 

+ .079 

\ 

.844 

h 

+ .638 

0 

-.124 

.422 

p 

j +.481 

+ .380 

+ .043 

.378 

d 

+ .430 

+ .632 - 

-.237 

.640 

e 

+ .509 

+ .494 

-.233 

.557 

f 

+ .604 

+ .513 

-.244 

.688 

9 

+ .845 

+ .303 

+ .050 

.808 

h 

+ .632 

+ .631 

+ .067 

.802 

i 

+ .455 

+ .434 

+ .267 

.467 

3 

+ .265 

+ .454 

+ .314 

.375 


XVIII, and XIX. Notice that in all the tables the communali- 
ties (A^) remain the same within the limit of accuracy determined 


Table XIX. — Factor Loadings after Two Rotations 
(Starting Factor Loadings in Parentheses) 



1 

2 

3 

A* 

a 

+ .744 (.8) 

+ .201 (.3) 

+ .501 (.1) 

.845 (.74) 

h 

+ .619 (.7) 

.0 (.0) 

+ .200 (.1) 

.423 (.50) 

c 

+ .401 (.3) 

+ .380 (.3) 

+ .270 (.3) 

.378 (.27) 

d 

+ .491 (.3) 

+ .632 (.4) 

+ .0 (.6) 

.641 (.61) 

e 

+ .558 (.5) 

+ .494 C.4) 

+ .042 (.3) 

.557 (.50) 

J 

+ .647 (.6) 

+ .513 (.3) 

+ .078 (.5) 

.688 (.70) 

9 

+ .716 (.7) 

+ .303 (.4) 

+ .452 (.3) 

.809 (.74) 

h 

+ .521 (.7) 

+ .631 (.5) 

+ .364 ( 3) 

.802 (.83) 

i 

+ .270 (.4) 

+ .434 (.5) 

+ .454 (.0) 

.467 (.41) 

3 

+ .080 (.2) 

+ .454 (.6) 

+ .403 (.0) 

.375 (.40) 


by the number of decimal places to which the computations have 
been carried. To sum the squares along the rows and thus find 
the unchanged is an important check on the correctness 
of the arithmetic, 

INTERPRETATION OF APPLIED FACTOR ANALYSIS 
We shall now speak of the numbers in parentheses in Tables 
XVII and XIX. They are the known loadings which the process 
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should have given back if it has a realistic meaning. They grow 
out of an effort on the part of one of the authors to test empirically 
the validity of multiple-factor analysis. We arbitrarily set 
weightings for each of ten “tests” in each of three common 
factors and then added for each test a specific factor weighting 
that would make the communalities nearly 1.00. Then we made 
four independent tosses of 12 pennies for each of 100 hypo- 
thetical “subjects,” one toss to represent his real ability in each 
of the four factors. Thus a subject achieved a “score” on a 
test which was the sum of the number of heads turned up for 
him in each of the four fundamental abilities multiplied by 
the loading assigned to those abilities for the particular tests. 
Suppose, for example, subject 1 had a score of 6 heads in factor 
1, 3 in factor 2, 5 in factor 3, and 7 in the specific factor for test a. 
In test a the assigned loadings were .8 for factor 1, .3 for factor 2, 
.1 for factor 3, and .5 for the specific factor. His score on test a 
would be (6) (.8) -f (3) (.3) + (5)(.l) -f- (7)(.5) = 9.7, multiplied 
by 10 to avoid decimals = 97. Thus scores were made up for 
ail of the 100 hypothetical subjects for each of the ten tests. 
Intercorrelation coefficients were then computed among these 
tests and entered in Table XIV. This duplicates the situation 
to which factor analysis attempts to get back by mathematical 
analysis. 

It will be observed that there is a fair amount of agreement 
between these “starting” values and the ones which accrued 
from the analysis. The coefficients of correlation between 
starting values and final values are 


Befoeb Rotation 



Factor 1 

Factor 2 

Factor 3 

r 

.63 

.70 

-.78 

After Two Rotations 

r 

.84 

.73 

-1.72 


These are highly significant r’s, though they are less than 
perfect. 

But notice the negative r for factor 3. That is a phenomenon 
of great importance to the practical worker, although little 
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attention seems to have been given to it in America. It is just 
as possible for any factor (except the first) to come out with 
the signs of all factor loadings reversed as with the correct 
signs. That is inherent in the mathematics of the situation. 
An inspection of Tables XVII and XVIII will reveal that the 
reversal of all signs in any one of the three columns, or in all of 
them, would not affect the cross products and hence would not 
affect the power of the factor loadings to give back the correct 
correlations and the correct communalities. Consider 

Ul&l -f- Cliibi H" Clsbs ~ Tab 

Perform this operation with factor loadings from Table XVII 
and get raj. Now suppose all signs in any one of the factors 
were reversed and again compute Tab. It will be found to be 
unchanged. Thus, reversed signs will support precisely the 
same matrix of correlations and the same communalities as 
correct signs. Thompson has observed and commented upon 
this phenomenon in connection with both Thurstone’s and 
Hotelling’s method. This uncertainty about signs certainly 
complicates the interpretation of the outcomes from multiple- 
factor analysis. We must be prepared to take an arithmetically 
large loading in a test as indicating that the test discriminates 
with respect to the factor, a large negative weighting having 
possibly the same meaning as a large positive one. 

If we could know that the signs are reversed, we could rotate 
out this reversal. If in Table XVIII we had transformed factors 
3 and 2 instead of 3 and 1, with 2 the dependent one, we would 
have let 63 = 0, and the transformation technique explained on 
pages 264 to 268 would have resulted merely in changing all 
signs in factor 3 and shifting it into column 2, while it would have 
left unchanged the weights in factor 3 but shifted thftTn into 
column 2. Then another transformation of 3 and 2 with 2 
dependent and a final transformation of 2 and 1 to get rid of a 
small negative loading in test b would have yielded a wholly 
positive manifold in much closer agreement with the known 
original loadings than those of Table XIX, all having correct 
signs. By this procedure the r’s would be as follows: 

Between final first factor loadings and original weighting, -f . 92 . ' 

Between final second factor loadings and original weightings, 4 -. 96 . 

Between final third factor loadings and original weightings, + . 90 . 



MULTIPLE-FACTOR ANALYSIS 


271 


These are very high r’s, and show high validity for the 
technique. The reason they fall below 1.00 is probably on 
account of unreliability due to sampling in our penny tossing 
and on account of the approximation involved in taking the 
highest inter-function r of a column as the communality. 

In the geometrical method the equivalent of what we did in 
the transformation mentioned on page 270 is to rotate the axes 
through 90 deg. All the signs of any factor can always be 
reversed by rotating through 90 deg. But the hitch is that 
we never can know with certainty whether thus rotating through 
90 deg. will bring us nearer the truth or farther from it. We 
are on highly speculative ground and can only do in this respect 
what looks most plausible. In the geometrical method the 
worker merely rotates his axes graphically until he gets what 
looks like most plausible results. In our empirical work with 
our method of transformation we appear to have gotten best 
results in a three-factor table by first transforming factors 2 and 1 
with 1 dependent, then factors 3 and 2 with 2 dependent, and 
finally factors 2 and 1 with 1 dependent. An analogous proce- 
dure with more factors would be to transform the factors in suc- 
cessive overlapping pairs beginning at the first, each time making 
the earlier of the pair the dependent one; then repeat the process 
in the same order to eliminate remaining negative terms. But, 
while we see a glimmer of theoretical basis for this, a satisfactory 
theoretical basis for determining a imique method of transforma- 
tion or rotation still awaits discovery. 

The reader is urged to try this type of transformation on our 
Table XVII as an exercise; and he is especially challenged to 
seek to discover some theoretical basis for a unique solution. 

An Applied Example 

But the fact that our situation was a made-to-order one made 
the procedure in the above example work out very smoothly. 
It was easy to get in ii a positivb manifold (all positive loadings) 
n.TirI a common factor because the situation had been set up that 
way. But not aU practical applications work out so neatly 
as chat. If the tests are of such a nature that some of them are 
inherently negatively interoorrelated in respect to any one 
factor, it will be impossible to get a positive manifold. Such 
is the case, for example, in the Bemreuter Pemonality Inventory, 
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where some of the items measuring presence of neurotic tempera- 
ment are so stated as to require a plus mark in the scoring while 
others are so stated as to require a negative mark. Here we 
could get a positive manifold in a matrix made from the items 
only if we transposed the scoring key so that all items would be 
oriented in the same direction. 

Another condition under which we may fail to get a positive 
manifold is when the tests are short or populations small, so 
that the r's have low reliability and some weightings are nega- 
tive by chance. Among the exercises at the end of this chapter 
we give a table of intercorrelations among a set of tests used 
for predicting achievement in the Engineering School at the 
Pennsylvania State College. These resulted in the factor load- 
ings of Table XX as taken from the original work sheets. When ^ 
the technique of rotation described above was applied to this 
table, factors 1 and 2 being transformed with the others held 
constant, two small negative values occurred in factor 1 at the 
fbrst rotation. Thus there was little promise from further 
rotations of other factors in the same direction involving factor 1. 
When other rotations were made about the most promising axes, 
they also involved some negative values; hence a positive mani- 
fold could not be achieved, and the best that could be done to 
make the factors comparable in meaning was to balance them 
against one another in such a way that each would have about 
the same extent of negative signs. This is shown in Table XXI. 

This difficulty is much more easily resolved in the graphical 
method of rotation than in our algebraic method. The Thurs- 
tone practice does not take the meaning of a positive manifold 
strictly; it accepts as zero small negative loadings, attributing 
them to unreliability. So, loadings down to — .20, or even down 
to — .40 if the population is not large, are accepted as not violating 
the principle of a positive manifold. The axes are rotated until 
they pass through the densest cluster of points, within the 
liberal definition of positive manifold just mentioned. This 
sort of process is more awkward by our algebraic procedure 
because it is not easy to see which test (other than the lowest 
one) to select for a zero loading. But really it makes little 
difference, provided the differential rotation is not great, because 
within reasonable limits the loadings of the tests within each 
factor remain in the same relative order so that the interpretation 
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of the outcome is unaffected. But if the worker wishes to try 
the more flexible graphical method of rotation as a hint of which 
test to accept as the one with zero loading, he can get directions 
for this process from the books by Guilford and by Thurstone, 
which are listed in the bibliography at the end of this chapter. 
However, no matter what method of rotation is employed, we 
cannot determine whether or not there is a general factor common 
to all the tests; the indeterminism of the methods of rotation 
forestalls that, unless the general factor is very prominent. 

The foregoing account shows how arbitrary are the arithmetic 
loadings when conditions cannot be imposed that determine a 
unique solution. They are equally arbitrary by our algebraic 
method and by the Thurstone geometrical method. As a matter 
of fact, the exact arithmetic weightings are not in themselves 
important; what we want to know is which tests go together as 
possessing the ability to measure a certain one or more of the fac- 


Table XX. — Oeiginal Factor Loadings (before Ant Rotation) from 
Nine Tests Intended to Predict Academic Success 


Tests 

Factors 

1 

2 

3 

4 


1. Number completion 

+ .405 

-.359 

+ .360 

-.124 

.438 

2. English usage 

+ .183 

-.289 

-.102 

-.194 

.165 

3. Scientific information 

+ .264 

-.312 

-.299 

-.189 


4. Arithmetic problems 

+ .301 

-.268 

+ .087 

+ .394 

.325 

5. MacQuarrie block 

+ .546 

+ .423 

+ .282 

-.079 


6. Thurstone-Jones sketching 

+ .531 

+ .142 

+ .150 

-.80 


7. Thurstone-Jones cards — 

+ .550 

+ .305 

+ .084 

-.114 

.416 

8. Detroit pulleys 

+ .364 

+ .103 

-.324 

-.126 

.264 

9. Minnesota form board 

+ .364 

+ .312 

-.131 

+ .342 

.357 


tors. For purely survey measurement purposes it would be 
satisfactory that a given test stand relatively high on all factors. 
But for diagnostic purposes it is desirable that we find tests which 
are high in ability to measure one of the factors while being very 
low (ideally zero) in weightings in the other factors. In the 
geometric system this is sometimes studied by plotting the 
positions of the tests on a plane if there are two factors or on a 
sphere if there are three — sticking hatpins in a ball and studying 
their relation to the spherical triangle generated ^ the 90-deg. 
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central angles between the vectors. Beyond three factors the 
process cannot be carried graphically. But, as a matter of fact, 
all these relations show up by merely inspecting Tables XX and 
XXI, or Tables XVII and XIX. We want, for a diagnostic 
battery, tests which agree in being high on one factor and low 
on the others. Failing this, we select as nearly as possible 
according to this principle. If the system lends itself well to this 
selection, our task will be a straightforward one. Under these 
circumstances in the geometric form the tests plotted on a hyper- 


Table XXI. — Factor Loadings on the Same Tests after 
Three Rotations 


Tests 

Factors 

1 

2 

3 

4 


1. Number completion. . . . 

-h.433 

-.128 

* +.368 

+ .314 

.438 

2. English usage 

+ .370 

+ .068 

-.076 

+ .133 

.165 

3. Scientific information .... 

+ .407 

+ .241 

-.186 

+ .184 

.292 

4. Arithmetic problems 

-.047 

+ .024 

+ .138 

+ .550 

324 

6. MacQuarrie block 

+ .018 

+ .325 

+ .669 

-.101 

.564 

6. Thurstone-Jones sketching 

+ .167 

+ .292 

+ .462 

+ .072 

.332 

7. Thurstone-Jones cards — 

+ .111 

+ .413 

+ .481 

-.046 

.416 

8. Detroit pulleys* 

+ .166 

+ .487 

0 

0 


9. Minnesota form board 

-.308 

+ .435 

+ .213 

+ .166 

.357 


surface would prevailingly fall around the vertices of a hyper- 
polygon (of a plane triangle if two factors, of a spherical triangle 
if three, etc.). The problem would then be said to exhibit 
“simple structure.” If a test or tests were not high in one 
factor and low in the others but were moderate in several or in 
all, then such test would not fall at the vertex, or even along the 
side, of the hyperpolygon but somewhere within the polygon; 
then the system would lack simple structure. But such relations 
can also be sensed directly from the table of weightings; indeed, 
with a little practice and insight into trigonometry, one can soon 
become quite adept at picturing just how the tests would fall if 
corrected for uniqueness (weightings divided by A in the table of 
original values) and plotted on a hypersurface. 

These observations prove the secondary character of the whole 
process of rotation. The configuration of points representing 
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the placement of the tests on. the hypersurface would be pre- 
cisely the same if plotted from the original loadings (Table XVII 
or XX) as if plotted after any kind and amount of rotation. 
For this configuration of points is determined by the intereorre- 
lations among the tests, and those are given in the data and can- 
not be changed. We get different arithmetic weightings only 
by looking “down” upon these points from different positions, 
and hence getting different “projections.” Inspection of 
Table XVII in relation to Table XIX and of Table XX in relation 
to Table XXI will reveal substantially the same story before 
and after rotation. Especially in all except the first factor the 
tests relatively high before rotation are prevailingly the same as 
those relatively high after rotation. In Tables XVII and XTX 
the r between original loadings and those after rotation is .71 in 
factor 1; .93 in factor 2; and .86 in factor 3. It is factor 1 that 
suffers most from failure to rotate. As it stands, it is likely to 
be deceptive as to the extent of the presence of a common factor. 
In Table XX it looks as if all the tests have a common factor 
(factor 1), but that disappears in Table XXI, after rotation. 
We, therefore, recommend rotation as facilitating interpretation, 
but we point out that its function is a secondary one. 

Aiter analyzing a correlational matrix for its factors, it is 
natural to try to interpret the meaning of these factors. This 
must perforce be a speculative process. We observe which 
tests are high in a factor and which low, and in which factors 
each is high and each low, and then try upon this showing our 
hypothetical interpretation. In Mercer’s study, involved in 
Tables XX and XXI, factor 1 (Table XXI) looks like a verbal 
academic-information ability, since English usage and scientific 
information play up high in it and the visualizing and manipula- 
tive tests have low weightings. Factor 2 is clearly ability to 
deal with visual space relations. Factor 4 seems to be mathe- 
matical problem-solving ability, since it is very high in arithmetic 
problems, moderate in number completion, and low in the 
visualizing tests. Factor 3 is harder to name; it is high in the 
MacQuarrie block tests and moderately high in number com- 
pletion and in the Thurstone-Jones sketching and card tests. 
Perhaps it is an ability to grasp rational space relations. But 
what was said above about the possibility of reversed signs in 
some of the factors might upset these interpretations. 
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It must be remembered that the factor loadings from a par- 
ticular sample are subject to considerable uncertainty on account 
of unreliability of measurement, especially with the higher 
numbered factors, although reliability formulas for the factor 
loadings have not yet been developed. On account of the prob- 
ability of fluctuations in weightings of particular tests from 
sample to sample and the uncertainty about signs, speculation 
as to the nature of the factors must be regarded as highly 
tentative. 

THE RELATION OF FACTOR ANALYSIS TO A CRITERION 

The factor analysis technique, as employed above and as 
usually employed, suffers from the lack of a criterion. Only 
such factors emerge as are entered in the battery. They are 
thus entered because they are alleged to be measures of a cer- 
tain function. So the analysis shows only what the tests have 
in common, not necessarily what are the factorial components of 
the trait alleged to be measured. By contrast with this, the 
multiple-regression technique gets weightings for factors in 
relation to their importance in the team in predicting a criterion 
(see pages 220 to 230). It would be feasible to put a criterion 
in with the battery in multiple-factor analysis; then it could be 
discovered how largely the criterion itself is wmghted with 
each of the factors; and those factors could be made the basis 
for selecting tests with which the criterion is heavily weighted.^ 
As Exercise 3, page 278, we give Mercer’s criterion r’s (the r 
of each test with academic achievement). We suggest that 
the student add these as a tenth row and a tenth column to the 
correlational matrix and see with what factor loadings the 
criterion (academic success) emerges. 

THE HOTELLING METHOD 

The Thurstone centroid method, which we set forth in this 
chapter, has a long lead in practice over any other method. At 
the time this book goes to press it has been used in research 
applications probably a hundred times as frequently as any rival 
method (excluding the older Spearman tetrad-difference tech- 
nique). But some people think that the method developed by 

1 At the suggestion of the senior author Henry L. Sisk did this. See “A 
Multiple Factor Analysia of Mental Abilities in the Freshman Engineering 
Curriculum,” J. Psychol., Vol. 9, pp. 166-177 (1939). 
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Hotelling and furthered by Kelley may prove in the end to be 
superior. The exposition of the Hotelling method is given by its 
authors in terms of hyperspace geometry, just as Thurstone's is. 
We judge that the arithmetic work is roughly the same in both 
methods. But the Hotelling method calls for no rotation of axes, 
for which reason its solutions are unique.^ Furthermore, some 
headway has been made in deriving standard-error formulas for 
the Hotelling factors. But as yet there is no certain evidence 
upon which to base a choice. Thomson says on this point: 

It will be seen from these first chapters that the different systems of 
factors proposed by different schools of ^‘factorists” have each their own 
advantages and disadvantages, and it is really impossible to decide 
between them without first deciding why we want to make factorial 
analyses at all. 

We cannot here take space to discuss a second method. The 
interested reader is referred to Thomson's semipopularized 
account of the several methods and to the publications by Hotel- 
ling and by Kelley in the bibliography at the end of this chapter. 

Exercises 

1. By the tetrad-difference technique determine whether or not there is an 
element common to all the measures involved in Table IV, pages 58 to 61, 
and determine the correlation of each test with this common element. Ven- 
ture an interpretation as to what this common element is. 

2. The table (page 278) from a dissertation by Margaret Mercer, gives a 
set of intercorrelations among certain tests presumably related to success 
in the Engineering School of the Pennsylvania State College. Find how 
many factors are represented, calculate the factor loadings, and compare 
your findings with those given earlier in this chapter, 

3. The following are the correlation coefficients of each of the above tests 
with academic success (grade-point averages) in the Engineering School. 
Put these criterion scores in the matrix as a tenth row and a tenth column, 
recompute the loadings, and see which tests are loaded with the same factors 
with which the criterion is heavily loaded. Interpret. 



1 

2 

3 

4 ! 

1 

6 

6 

, 7 

8 

9 

r's 

.250 


.348 

.387 





.128 


^But E. B. Wilson and Jane Worcester challenge the psychological 
meaningfulness of the Hotelling factors. See **Note on Factor Analysis/' 
Psychometrikaj Vol. 4, pp. 133-148 (June, 1939). 
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Tabijs XXII. — Intbkcorbelations among ISTinb Ability Measures 


Test 

1 

2 

3 

4 

5 

6 

7 

8 

9 

1. Number com- 
pletion 


.158 

.144 

.279 

.205 

.144 

.214 

.083 

-.089 

2. English usage . 

.158 

— 

.196 

.030 

-.029 

.100 

.024 

.020 

-.056 

3. Scientific infor- 
mation 

.144 

.196 

_ 

.109 

-.085 

.158 

002 

.194 

.010 

4. Arithmetic 
problems 

.279 

.030 

.109 



.058 

.063 

.027 

.021 

.195 

6. MacQuarrie 
block 

.205 

-.029 

-.085 

.058 


.426 

.412 

.262 

.234 

6. Thurstone- 
Jones sketch- 
ing 

.144 

.100 

.158 

.053 

.426 


.317 

.006 

.227 

7. Thurstone- 
Jones card 

.214 

.024 

.002 

.027 

.412 

.317 


.245 

.269 

8. Detroit pulleys 

.083 

.020 

.194 

.021 

.262 

.006 

.245 

— 

.179 

9. Minnesota 
form board 

-.089 

-.056 

.010 

.195 

.234 

.227 

.269 

.179 

— 
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CHAPTER X 

THE NORMAL PROBABILITY CURVE 


Derivation of the Formula, — ^In the algebra of chance it is 
shown, that if each of n independent events has ^5 chances to 
occur and q chances to fail, the total combinations of successes 
and failures is prophesied by the binomial expansion 

(g + p)« ^ g«~2p2 4. (159) 

where the exponent of the p expresses the number of successes 
and that of the q the number of failures, and the coejBficients 
represent the relative frequencies with which each of these com- 
binations of successes and failures is likely to occur. Any 
particular term in the expansion represents the probability of 
the occurrence of the number of successes indicated by the 
exponent of p in that particular term. If p and q are equal, 
indicating an equal probability of success or failure (half the 
times the chance of success, the other half of failure), the binomial 
becomes 




+ 


+ 


Q- 


Since erGT-sy 3 this expression obviously becomes 

(1+0 +"^”."2"^ (5) + • • • +Q) 


There is much in genetics to suggest this as descriptive of the 
operation of determiners in controlling growth. Determiners 
in the body cells are inherited from the two parents, and, on the 
law of chance in mating, in the long run a determiner for the 
presence of a trait more favorable than the average is equally 
likely to be present or absent. When present, such a determiner 
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contributes something toward the characteristics we measure 
as success — ^height in a cornstalk, quickness of reaction, intel- 
ligence, or academic success in a pupil. It is plausible enough 
that these composite characteristics may be the outcome of 
the operation of many determiners for elemental constituent 
traits obeying singly the principle of equal probability of presence 
or absence and obeying jointly the principle of chance described 
by the binomial expansion. In like manner, behavior that is not 
the expression of the chance combination of elemental traits in 
the reaction of a biological organism but is the product of a 
combination of elemental factors or forces, each unit of which 
obeys the laws of chance, or behavior that is the result of an 
aggregation of constituent units each of which is determined 
according to laws of chance (as groups composed of the sort 
of individuals we have been discussing) may be expected to 
conform to this same principle of chance combinations as 
expressed in the binomial expansion. 

At any rate the composite traits or conditions we measure 
in educational statistics and in most other statistical applications 
arrange themselves with remarkable frequency in distributions 
that conform to this principle — ^which we call normal distribution. 
Consequently, the assumption of normality of distribution 
underlies much of our statistical work. The curve of a normal 
distribution is a peculiar bell-shaped one with which all students 
are already familiar. It will be the essential burden of this 
chapter to prove that the formula for the curve is 


N 

y =S Q 2ir» 

(r\/27r 


Since the normal distribution is of such fundamental impor- 
tance in statistics and since the student makes so much of its 


mathematical properties, the reader will wish to see a develop- 
ment of its equation. 

From our previous discussion of the binomial expansion we 
have seen that the successive terms. 



n{n — l)(n — 


n{n — 1) (TlY n{n — l)(?i — 2) /'iV 

1-2 Vsr TTl Var * ■ * ' 

2)(n - 3) - ■ (n ~ ^ + 1) (l\ (\\ 

1 • 2 • 3 • • • s \2/ ' ' \2/ 
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represent the probabilities of the occurrence of 0, 1, 2, 3, . . . s, 

. . . , or n successes, respectively. The last factor of the 
factorial expression in the denominator of each term represents 
the number of successes predicted by that particular term. 
We shall refer to these binomial terms as ordinates and to 
the corresponding numbers of successes as scores. Our problem 
then becomes that of obtaining an equation which will express the 
dependency of ordinate upon score value. 

In Fig. 19 we have plotted “number of successes” along 
the horizontal axis and corresponding “probability of success”. 



along the vertical axis. The extremities of successive ordinates 
are joined in order to obtain the resulting frequency polygon. 

The Y measurements are ordinates corresponding to the X 
measurements which stand for the different score values or 
number of successes. For example, j/s represents graphically 
the probable frequency of the occurrence of the score value xs. 

For the sake of clearness we shall list our set of scores together 
with their respective probabilities in the ordinate-abscissa 
notation. Our set is composed of 


2/0 

2/1 

2/2 

2/s 


/l\” 

= 1 2 1 j the probability of a score of value 0, or xo 

; the probability of a score of value 1, or xi 
n{n - 1) (lY 

12 [2)’ 


the probability of a score of value 2, or Xt 


_ n(n — l)(n — 2) 

l-2'3 




the probability of a score of value 

3, 


S/. 


n(« — l)(w — 2) • • • 

1 •2-3 • • ■ 


(n — s + 1) 





3 
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the probability of a score of value s, or x. 


j/«_i = n ( 0 " } the probability of a score of value n — 1, or Xn^i 
, the probability of a score of value n, or Xn 

Unless the reader is skilled in the manipulation of algebraic 
expressions, he may perhaps find difficulty at first in understand- 
ing how the expressions for ys was obtained. Notice that 5 is a 
generalized expression for any y subscript; it may stand for 
any value of x and thus serve to designate the group of scores 
corresponding to that value of x. Observe, for example, the 
form of the expression for 2 / 3 . In this instance, 5 = 3. More- 
over, we notice that the factorial expression in the denominator 
terminates with 3. The last factor in the numerator is (n — 2), 
which is precisely (n — 3 + 1), in which 5 has been replaced 
by 3. Since the expression gives the desired quantity for any 
particular chosen value of s, we are led by induction to the general 
expression for y,. (The reader should verify the expression for 
5 = 4, 5, 6, etc.) 

The general expression for can be written in a more simplified 
form by multiplying both numerator and denominator by 
the quantity 

(n — s)(n — 5 — l)(n — 5 — 2)(n — s — 3) • • • 3 • 2 • 1, 
which is, of course, (n — 5 ) I The equation for y* becomes 

— — l)(n — 2) * - - (n — 5 + l){n — $){n — 5 — 1) 

(1 • 2 • 3 • • • s){n — s){n — 5 — 1) 

- S 21 /iV 
• - Z 2 l\2j 

which in terms of factorials may be written 


nl AV 
~ sl{n - s)\\2/ 


[Probability of a score 5 in the 
binomial (i + i)«] 


(160) 


Now suppose tbat in our development n is very large and for 
convenience is even and equal to 2r. Then the probability of 
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the occurrence of exactly r successes would be yr and would be 
expressed by the equation 


Vr 


2r\ 

rl{2r — r) ! 



in which n has been replaced by 2r, 



[Probability of obtaining exactly r 
successes in the binomial (§ -f 


(161) 


The task of evaluating the expression for yr becomes laborious 
for even small values of r when substitution is made directly 
into the formula. A good approximation can be obtained, how- 
ever, by using Stirling’s approximation formulas for factorials. 
Stirling’s formula is as follows: 


n\ = e“”n'^i(27r)i (Approx.) 


(Stirling's approximation 
formula for factorials) 


(162) 


We shall apply Stirling’s formula to evaluate Eq. (161). 
Making the substitution and remembering that in the numerator 
of (161) 2r must be used as the n of the approximation formula 
and that in the denominator we use r, we find 


6-2’-(2r)2’+i(2^)* 

Vr - e-^r+i(2^)ie--r'+K2T)i\2) 

Upon simplifying by canceling terms that are common to both 
numerator and denominator, we are left with the formula 


1/r 



[Approximate probability of obtaining exactly 
r successes in the binomial (i + 


(163) 


Equation (163) gives a very good approximation to the prob- 
ability of obtaining exactly r successes out of the range of 2r 
scores. It denotes, therefore, the ordinate at the mean of the 
binomial distribution since we are taking n = 2r. 

In developing the equation for the normal curve, we are seeking 
an expression that will hold for all points in the distribution of 
scores on either side of the mean value. If we let x be the dis- 
tance from the mean of the distribution to any other given 
point, then r + x ox r — x will represent the score whose prob- 
ability or ordinate value we are looking for. This amounts to 
finding^ an expression for exactly r x successes or a score of 
r -}- » in the binomial distribution. 
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Substituting r + x tor s and 2r for n in the general formula 
(160), we have 


Vx = 


2rj 

(r + xy{2r — (r + :r)]! 



or 


Vx ^ 


2rj 

{r + x) !(r -- x ) ! 



[Probability of a score x 
units from the mean in 
the binomial (§ + 


(164) 


We now come to the task of evaluating Eq. (164). Before 
applying the approximation formula, it is convenient to rearrange 
the form of the equation by multipljdng and dividing the right- 
hand member by r! r! We make this change and write 


Vx = 


2r! / iV"^! r! rl 

r!r!\2/ J (r -f- a:)!(r — a:)! 


The expression within brackets is the same as Eq. 161 which we 
have already found to be 1/ («•)*. 

Hence, 


( 1 ) 


_ _1 r\r\ 

~ (irr)l (r -f x ) !(r — x)\ 


The factor is evaluated by applying the Stir- 

ling approximation formula. The task is rather long and 
involves detailed simplification. It is left to the student as an 
exercise in algebraic manipulation.^ It is sufficient to say here 

— £! 

that its value is approximately e . Substituting this value in 
(A) we have as our approximation formula for the probability of 
the occurrence of a deviation x in the binomial distribution 


Replacing r in (B) by its equal n/2, 

1 - 2*1 



Take logarithms of the expression, use Stirling's approximation 
formula for the factorials, simplify, and then taJke the antilogarithms. 
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which reduces to 


Vx = 



[Approximate probability of a score x 
units from the mean in the binomial ( 1651 

a + m ^ ^ 


We show on page 298 that for a point binomial cr^ = npq. In 
this development p = q = so that o-^ = n/4, or n = 
Substituting for n in Eq. (165) and dropping the subscript 
from y to denote that we shall assume the formula to hold 
continuously throughout the range of x values, we have 


which reduces to 



e 


2a;8 

4a-a 


y 





e 


(Approximation equation for the point 
binomial) 


(166) 


Formiila (166) expresses the probability, within the. limits of 
Stirling’s formula, for the point binomial for n very large. 

Mathematicians often make a more direct approach to the 
normal curve equation by setting up a differential equation of 
the form 


dx 


= —Cxy 


which satisfies certain conditions which we know to be true for 
the normal curve. The integration is performed as follows: 



—Cxy 


Separating the variables. 


^ = -Cx dx 

y 

Integrating, 

logy = -Cy + X 


Solving for y, 



286 


STATISTICAL PROCEDURES 


As was shown in the previous edition of this book (pages 231 to 
234), 


A = 


and (7 = -4 


r\/2T 


whence 


1 — 

y = — -= e 2ir> (Normal probability function) (167) 

<rV 2^ 

This is precisely the same as formula (166). We see, there- 
fore, that our approximation formula, (166), expressing the 
point binomial probability is precisely the formula for the normal 
curve. 

The right-hand member of formula .(167) can be factored as 

in whichi the quantity within parentheses is usually denoted by 
the letter z. Values of z have been tabulated for various values 
of x/cx* But from the above expression it is evident that 

((7) y = \z 


So if our distribution has unit area and unit standard deviation, 
y = z and the z values are merely the ordinates of a normal 
distribution of unit area and unit standard deviation. The 
equation for z would, of course, be 


iD) 



as* 


6 


2 


If iV is the total area under the curve, instead of unity, the 
equation of the normal curve becomes 


y = 


N 




e S'* 


(Normal probability curve of area N) 


(167a) 


Equation (167o) follows from the fact that the area obtained by 
integration would be N times that obtained by integrating (D), 
which we shall see is unity. 
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PROPERTIES OF THE NORMAL PROBABILITY CURVE 


Modal Ordinate. — At the origin, that is when x = 0, formula 
(167) becomes 


^ ■\/ 2lTrff 


(For e® = 1) 


This tells us that — ;=- is the value of the y ordinate at the noiddle 
V2iro- 

of the distribution because we have measured our x deviations 
from this middle point. If we designate this modal ordinate by 
yo, the normal curve equation may be written 


(^) 


y = 


■2o-> 


Area under the Normal Curve. — Since we began the develop- 
ment with the expansion of the binomial -|- i)”‘, the sum of all 
the ordinates of the binomial is unity; for -f = (1)" = 1. 
This means that the curve whose equation is (166) should by 
analogy obey the condition 


J+» 1 

= 1 

- » \/27r<r 

i.e., the area under the curve from a distance infinitely far to the 
left of the y axis to a distance infinitely far to the right of the 
same axis should equal unity. 

The x^ term in the integrand assures us that the curve is 
symmetrical with respect to the y axis; for no matter whether x 
is positive or negative, its square must necessarily be positive. 
Thus the area under the curve between the limits — » and -1- «> 
is the same as twice the area under the curve between the limits 
0 and + «> . Letting A denote the area \mder the curve, we may 
write 

A = 2 I ■. — e 

Jo v2ir<T 

Since — i=- is the height of the ordinate at the origin and 
v2v<r 

represents, therefore, the mode of the distribution, it is a constant 
quantity in any given distribution. We may, consequently, 
remove it from beneath the integral sign without affecting the 
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integratioa involved. Then our expression for the area may be 
written 

A = e 

V^TTO- Jo 

It so happens that the evaluation of the integral appearing in 
this last equation involves the application of certain advanced 
mathematical functions which, if introduced at this time, might 
serve to confuse the reader. It is listed among the standard 
types in most integral tables and its value is given as \/^c/2. 
We see that this value is the reciprocal of the coejflEicient of the 
integral itself in the equation directly above. The product of 
the two quantities, of course, is unity; and we see that A = 1. 

Standard Deviation of a Normal Distribution. — We have 
observed elsewhere that in the case of a finite number of dis- 
crete variates the standard deviation is defined by the relation 
0-2 = Xx^/Nf where x denotes a deviation and N the number of 
scores. The analogous definition in the case of the continuous 
normal distribution which extends infinitely far to the left and 

f_ yxHx 

to the right of the mean is o-** = ^ j where y denotes the 

predicted frequency \ v = e of the deviation x, and 

N denotes the total number of deviations — area under the curve. 

Mean Deviation of the Tail of a Normal Distribution. — One of 
the many important properties of the normal curve involves the 
expression for the mean deviation of a truncated portion of a 
normal distribution. It will be of value, therefore, to develop a 
formula for this quantity. We shall deal with the normal 
distribution of unit area and unit standard deviation. 

Let d represent the mean deviation, q the proportion of cases 
in the distribution from the point of truncation xi on to <» . The 
ordinate value of any point in this section of the area will, of 
course, be z. Then, since by the definition of a mean we must 
sum all deviations and divide by their number, our problem of 
fi n ding d will be that of evaluating the expression 



« 
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When we replace the z appearing under the integral sign by its 
equal given in (D), our expression for d becomes 


d = 



1 

■\/2t 

e 


^xdx 


In order to facilitate the integration involved in the above 
equation, let us insert a minus sign before the x appearing as one 
of the factors under the integral sign and compensate for tbig 
change by inserting another minus sign before the integral sign. 
Then 

^ ~L 

2 


Aside from the constant which may be taken outside 

the integral sign and which does not enter into the integration, 
our integral to be evaluated between the linoits Xi and <» is of the 
t 3 rpe form /e“d«, in which form u = —x^j2 and du — —xdx. 
Now we know that J&^du = e** (see page 36). Hence, 


d = 



Upon evaluating the quantity in the numerator between 
the designated limits, we find that for the upper limit ( oo ) the 
quantity approaches zero,^ and for the lower limit (xi) the 

a;i> 

quantity obtained is ^ , which is the value of z (say Zi) 

at the point Xi. When the complex expression in the numerator 
above is replaced by its equal Zi, we obtain, therefore, 



(Mean deviation of the tail of a 
normal distribution) 


(168) 


Mean Deviation of a Portion of a Normal Distribution. — ^We 
shall now develop a formula for the mean deviation of a portion 

^The reader will .observe that because of the negative sign appearing 
before the exponent of e the whole factor will approach zero with increasingly 
large values of x, because the e with a negative exponent in the numerator 
is the same as the e with a positive exponent in the denominator of a fraction. 
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of a unit normal distribution included between two designated 
points of division. 

Let qi be the proportion of cases lying beyond the point rci, 
and let qz be the proportion of cases lying beyond the point X2. 
Then the area (proportion of cases) between xi and X2 is qi — gg. 
Hence, from our definition of a mean we may write 



We may, of course, replace z by its equal as given by (D) and 
rewrite the equation for d as follows: 


d = 


r 


1 - 


\/ 27 r 


^x dx 


Qi - q2 


We have already integrated the numerator of the above 
expression (page 289 ). Making use of this value, we may write 


d = 


1 

\/^ 


e 


£2 

2 


Qi “ Q2 


Substituting the upper and lower limits, we now have 




1 

V^27r 


e 


Xi* 

2 


2 i - ffa 


The individual terms of the numerator of this last equation are 
nothing more than and 22, respectively. Hence 


d = 


(gi — zi) 

(ffi - 92 )’ - 


or, if we call the proportion of cases lying in the sector between 
2i and 22, q, then 


2i — 22 (Mean deviation of a portion of a normal 
— - — distribution of unit area and unit (TfiSa'l 

2 standard deviation) ^ ’ 


where 21 is always the left-hand ordinate bounding the portion 
of the distribution and 22 is the right-hand ordinate. 
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THE VALUES OF AND jSa FOR A NORMAL DISTRIBUTION 

Throughout many of our developments we have had occasion 
to say that /3i = 0 and ^2 = 3 in a normal distribution. We 
shall now give the proof for these values of the /S's. 

We have the following definition for jSi: 

, _ {^xVNy 

^6 

In the summation of the the frequency must, of course, be 
considered. Remembering that the frequency at any value 
of X is the corresponding y, we may express the above for a normal 
distribution as follows: 




+ ” N - 

7 = ^ 

- 00 


r 1 

xHx I — = < 

^ _ LJ-«, 


1 


ff® 


We are now led to the evaluation of the integral appearing 
in the numerator of this fraction. For this purpose we shall 
resort to the familiar “parts” method. We have 


fu dv = vx — Jr du 


(see page 38), where ^udv represents the integral we are to 

1 

evaluate. Let dv — — 7 = e ^‘x dx, and let u = r®. Then, 

27r 

multiplying both numerator and denominator by a and indicat- 
ing the integration, 

J c 3 ?^ ^ 

— 7 z=r e 2<r>-rdx 

The integral on the right is only a slight modification of the one 
already found. It is 

X* 

£_ . 2<r« 

The differential for our expression for u k du = 2xdx. When 
we substitute the values <rf u, v, and du into the parts formula, 
J«dt) = «v — jvdu, the integral in question becomes, after 
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due consideration of sign changes and noticing that u dv is the 
expression in the p formula above for which we are integrating, 



1 

— = e 
V 27r 


£L 


— <r 


e x^ + 



X dx 


- +00 
J 00 


We must now integrate the second term of the expression 
within the brackets. In order to do this it is convenient to 
make certain algebraic adjustments so that we may apply the 
same standard integral form we have just used. If we divide 
the X factor appearing under the integral by — our integral 
becomes at once of the form fe^du. If the reader will perform 
the task, he will find that the second term of the brackets becomes 


~2(r^ 


-£1 

e 


Now the value of the quantity at the left of the equation will 
be that value’ obtained by evaluating the two right-hand terms 
between the limits — co and + . Since the first of these terms 

contains an even power of x^ it will have the same value at -b oo 
and — 00 , so that the value at the upper limit minus the value 
at the lower limit will be zero. Since the exponent of the e in 
the second term has the negative sign which would have the 
effect of putting it in the denominator with a positive exponent 
and leaving in the numerator the constant 2o^/\/^, the entire 
term will also approach zero for increasing values of x whether 
positive or negative. Therefore the whole numerator of the 
fraction to which / 3 i is equated (called the third moment or ^3) 
is equal to zero, since it equals the two members on the right of 
the equation which sum to zero. We would, therefore, have 



(jSi for a normal distribution) (169) 


In this development it has been incidentally shown that 
called ^3, equals zero in a normal distribution. It can 
be readily shown that every other odd moment of a normal 
distribution also equals zero. 

The following relation defines Pz- 




M4 _ ('Zx^/N) 
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Expressed in terms of the integral, this becomes, for a normal 
distribution. 






+ « TV 

•*” 0-4 


<T\/2ir 


x^dx 


Canceling the N^s and clearing of fractions, 


0 - 4^2 = 



—~e ^-^x^dx 


Apply the method of parts, letting u = x^ and 


Then 


dv e ^^xdx. 



Furthermore, since u = x^, du = Zx^dx. Upon substituting in 
the parts formula, Judv = uv fvdUy and at the same time 

remembering that the constant factor — is to be carried along 

(TV 27r 

throughout the entire process, we have 


-2 0-2 /* 

— — x^e 2®-* -I I 0 ^^x^dx 

<rV^ <rV^J J-.. 

We observe that the first term within brackets is of the order 
x^/e^*, -When we let x approach the infinite limits, this term 
takes on the indeterminate form a>/oo. We must, therefore, 
resort to a method of evaluating indeterminate forms provided 
by the calculus, but which we did not discuss in our calculus 
chapter. This method consists in differentiating repeatedly 
the numerator for a new numerator and the denominator for a 
new denominator until finally a meaningful value is found, when 
substitution of limits is made into the last of the series of expres- 
sions thus obtained. The reader may easily verify that after 
differentiating three times in this manner we obtain the expression 

6 

12x^* + 8 x»e** 

Since this expression contains a constant in the numerator, its 
value will be zero when x equals + «> or — Henee the first 
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term becomes zero -when evaluated between the limits — <» 
and + 00 , Let us now examine the second term. It may be 
written 

J +co 1 vr _»i 

The value of the integral is <r*, so that the whole expression 
is equal to Z<r\ Substituting this in our equation above for 
/Saff* and dividing through the equation by <r^, wo have 


= 3cr^ 

jgji = 3 C/Sj for a normal distribution) (170) 

Since the numerator of our equation was tn, it has followed 
from our development that, in a normal distribution, m<i = 3ff^. 

POINTS OF INFLECTION ON THE NORMAL CURVE 

In the calculus it was shown that a condition for a point of 
inflection upon a curve is that the second derivative be equal to 
zero. If, then, we set the expression for the second derivative 
equal to zero, we are in a position to solve the resulting equation 

for the values of the independent 
variable which satisfy that 
condition. 

Now let us consider the equa- 
tion of the normal curve and 
investigate the values of x which give us the points of inflection. 
In the accompanying diagram, we wish to find the distance a. 
According to the argument given in the calculus, we must 
differentiate the equation of the normal curve twice and set the 
result equal to zero. Upon solving this final equation for x, we 
shall- find those values which give the position of the point of 
inflection. The computation is as follows: 

JV -2i 

The equation y = — = e 2 <r* is of the form y = Ae^, where 
<r\/27r 

A is a constant coefficient and » is a variable exponent. Since 
the constant multiplier does not enter into the differentiation 
and since the derivative of the form e’ is e'’idv/<ix) (see page 24), 
we may write our first differentiation (dy/dx) = Ae'°{dv/dx). 
The right-hand side of the expression for the first derivative is 



Fig. 20 . 
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seen to be a product of the two functions and dv/dx with the 
constant A again appearing as a multiplier. Remembering that 
the derivative of a product is equal to the first times the deriva-* 
tive of the second plus the second times the derivative of the 
first, the reader will readily observe that the expression for the 
second derivative becomes 


dx^ 



We must now set the expression for the second derivative equal 
to zero and solve for x in order to find the points of inflection. 
Before doing so, however, we must replace the derivatives 
appearing in the right-hand member by their equals as deter- 
mined from the replacement of the letter v for the more complex 
exponent appearing in the normal equation. We have that 



dv X 

^ ^ (see page 7 — differentiation of x”) 

dH _! 

da?~' (T^ 


Making these substitutions into the expression for {d^y/dx^) and 
equating the expression to zero, 

The constant A may, of course, be divided out. Since the factor 
— ** 

cannot equal zero for any finite value of «, it may likewise 
be divided out. Thus we are left with the following equation 
from which to determine the value of x that will be a point of 
inflection: 



Dividing both sides by l/cr® and transposing, 



Enxoe X* ■* <r®, and x = ±c 
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We have, therefore, discovered that the points of inflection 
of the normal curve lie at a distance of one cr to the right and to the 
left of the mean. 

Mean and Standard Deviation of the Point Binomial. — In our 

development of the formula for the normal curve, we began with 
the binomial expansion, the successive terms of which represent 
the occurrence of 0, 1, 2, etc., successes. We saw that for 
increasingly large numbers of events (the n of the exponent of 
the binomial), the distribution of successes approached nearer 
and nearer the normal form when p and q are equal. Often, 
however, we are in a position to deal with distributions of which 
we know the p and the q and the n as determined by sampling. 
It is convenient, therefore, to have a formula for the standard 
deviation in terms of these quantities. 

Let us begin by making a table of our assumed scores. Since 
each term of the expansion represents the probability of the 
occurrence of a particular score, the frequency of each score will 
be the product of the probability of its occurrence and N, the 
total number of scores. With this in mind, we may display our 
table as follows: 
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We may factor out of each term in the brackets the quantity 
Nnp. Doing this, we may write 

+ — ~ ~ «*■’!’’ +■•■ + •••+ p-'] 

The expansion now left within the brackets is that of the binomial 
(? + P)”“^ therefore equals 1, for ff + p = 1. Hence, 
we have, after canceling the N appearing in both numerator 
and denominator of the fraction, that 

m 

M = np (Mean of the point binomial) (171) 

From the definition of standard deviation 


<r2 


S/a;* 

N 



a 


The second term in this expression becomes, in view of the 
development just above, n*p*. Our problem now is to find 
Xfx^/N. Adding column (/a:*), and dividing by N, we write 


S/a:* 

N 


■=» ^ |^iVng’‘“*p + N — 3;} 2"~*p® 

4 - N — gn- 8 p» 4 . iv-jiv] 


Factor out of each term within brackets the quantity Nnp. 



^ [i-‘ + r-v + 

4. ... 4. ... 4. 

/ 


The expression now appearing within the brackets may be 
written as the sum of two series by properly grouping certain 
terms and portions of terms. That is, we may write 
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r . . 2(n — 1) , , 3(m — l)(7i — 2) » 

+ tili- 1 ^ 

+ ’ • • + np»-i j = 

+ ~ ^K^ . ~ j ) gn-3p2 + . . . + p»-l| 4. |(„ _ l)gf"-2p 

_|_ " - ^ -p ^ g“-*p2 + ■ • • + (n — l)p'‘~*j- 


The expression within the first set of braces is the expansion 
of the binomial {q + p)”“‘ and therefore equals 1. We may 
factor {n — l)p out of the second set of braces and write this 
expression as (n — l)p{g”“^ + (w — 2)q^p + • • * 4- 
The expansion appearing within this final set of braces is that 
of the binomial (q + p)"“^ and therefore equals 1. Thus we 
find the value of the expression given in brackets above is 
1 + (n — l)p. Hence, 


^ = ^[l + (n- l)p] 

= «.p(l +np -p) 

3/3.2 

= np + n^p^ — np* 


We are now in a position to substitute our values of Hfx^/N 
and {Sfx/N)^ into the formula for Making those substitu- 
tions, we obtain 

== np + ~ 

Collecting, we have = np — np^. Factor the right-hand 
member, v* = np(l — p). But since g -|- p = 1, we have 
that 1 — p = g. Therefore, <r* = npq. And 


<r = y/npq (Standard deviation of the point binomial) (172) 

Shape, Symmetry, Extent, and Slope of the Normal Ctirve.-— 
We have already pointed out in our previous discussion that the 
normal curve is a symmetric bell-shaped ctirve whose slope at 
equal distances to the right and to the left of the mean is theo- 
retically always the same. Furthermore, tihe curve changes 
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from convex to concave at a distance of o- on each side of the 
mean. 

An additional property of the normal curve is its approach 
to the z a.xis as we go out farther and farther in either direc- 
tion. This asymptotic approach may readily be demonstrated 
mathematically by considering the form of the equation and 
observing that because of the negative exponent of the term e, 

I 

the equation may be written y = {N /a-^/2v)(l/e Now, 

as we take increasingly large values of x in absolute value (either 
positive or negative), the denominator of the fraction on the 
right involving z^ becomes larger and larger, and as a consequence 
the right-hand member becomes smaller and smaller. This 
amounts to saying that y approaches zero as x increases without 
bound. Hence wo see that, although for most practical purposes 
the normal curve is taken to include all the cases between 3.5<r 
or 4.0<r in either direction from the mean, this is not the actual 
situation if a sufficiently large sample of the total normal popula- 
tion wore available. 

The Principle of Least Squares. — In the development of many 
statistical formulas we have found it necessary at times to 
minimize the sum of the squares of errors resulting from the use 
of observed rather than the actual scores. Because this proce- 
dure plays such an important part in so many developments and 
because its application is so universal, the advanced student 
of statistics will wish to examine the principle upon which it 
rests. 

Let us assume that our errors make a normal distribution. 
Then the frequency of the occurrence of a particular error would 

be given by the normal equation y — y^e ^ . The probability 
of the occurrence of a particular error would be y/N. Hence, 
the probabilities representing the occurrence of the ewors 
»i, ® 2 , a* would be given by the quantities 

-cS.* -cf -cf 
N ’ N ’ N ’ ■ ' ■ ’ N 

Now it is a fundamental theorem in the study of probability 
that the probability of the simultaneous occurrence of several 
independent events is equal to the product of the probabilities 
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of the several events, respectively. Hence in a normal distribu- 
tion the probability that the errors xi, xs, Xa, , x„, will 
occur at the same time would be given by the product of the 
above quantities which represent the individual probabilities. 
If we denote the measure of this product probability by P, wc 
shall have 

— c-’- 

rTn p _ 2/0® ^ . 2/“® ^ .M ^ ... M ^ 

^ -T ir N N 


We may, of course, multiply by adding the exponents and write 


«?) 


P = 2/i« 

^ N’' 


Placing the exponential factor in the denominator and at the 
same time changing the sign from minus to plus because of the 
change, 


(H) 


j/gJV-" 

+ 5(®l2 + *sa + »l»-l- • + !»!) 

e 2 


Equation {H) shows that the value of P is a fraction who.so 
value depends upon the sum of the squares of the errors. Since 
the value of the fraction is greatest when the denominator is 
least, the value of P will be greatest when the quairtity within 
parentheses is least. That is, wo must minimize the sum of 
the squares of the errors in order to obtain a maximum probability 
of the concurrence of these errors. From this standpoint, 
therefore, we have a partial explanation of the principle under- 
lying the least-squares method used in many of our statistical 
developments. 

Normal Probability Tables — ^Their Construction and Uses. — 
Many interesting properties may be pointed out through an 
analysis of the construction and uses of probabilities tables. 
These tables usually give ordinate values which represent the 
probabilities of the occurrence of corresponding deviate valu<!S 
and integral values (areas) which represent the probabilities 
of the occurrence of a deviate within a given range, i.e., between 
any two particular ordinates. When the entire area under the 
curve is taken as 1, the area between any two designated ordinates 
is, therefore, the proportion of the total population falling within 
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that range. Some tables give additional integral values ■which 
show the proportions of the distribution to the left and to the 
right of a particular ordinate. 

We have seen that the equation of the normal curve of unit 

1 ~ 

area (see page 286) is y = — 7= e where x represents the 

crv 

deviation of a score from the mean of the distribution, <r the 
standard deviation, and y the ordinate which gives the probability 
of the occurrence of the deviate x. We have designated the 

quantity (l/\/^)^ by the letter 2 , and written 
j/ = i z [Eq. (C), page 286] 

The values of z which correspond to different values of x/c 
may be computed by direct substitution into the designated 
quantity above. For example, the value of z for the sigma 
unit z/cr = 2 could be found by simply evaluating the expression 
_i2i! 

(1/V2ir)e ^ . The value of this expression, as can be verified 
by simple arithmetic processes, turns out to be 0.05399. If the 
reader will turn to Table XLIV, he will find this value of z appear- 
ing opposite the number 2.00 which appears in the x/o- column. 

At this stage it may be well to point out that the z values which 
appear in the tables are to be taken as ordinate values only when 
the <r of the given distribution is 1. Otherwise, we must divide 
by the <r of the distribution under consideration in order to 
obtain the correct ordinate for a particular sigma unit value. 

This fact is at once apparent from the form of Eq. ((7). Hence, 
if we desired the probability of the occurrence of the sigma unit 
2.00 in a distribution whose standard deviation is 6.00, we should 
have for the corresponding ordinate value 

y = i z = ^ (.05399) = .01080 

This tells us that we shoxild expect the occurrence of the sigma 
unit z/ff = 2.00 approximately once in every hundred random 
selections from our normal population. 

In order to obtain the area under the nonnal curve between the 
mean ordinate and any other chosen ordinate, it is necessary to 
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integrate the normal equation between the values of cc/cr which 
correspond to these particular ordinates. Anal3rtically this 
means that, if we let A represent the required area, our problem 
is to integrate the following expression; 


^ " Jo 

where the upper limit refers to a definite sigma unit value. 

In order to simplify matters, it is convenient to make the trans- 
formation t = z/<Tm Eq. (I). Our integral then becomes"^ 


(J) 


A = 



_L* 

e ^dt 


There is no general formula for the value of this integral. For 
this reason, mathematicians have turned to convergent series in 
order to approximate to its value for different values of t. The 
process consists in the termwise integration of the series obtained 

by expanding the function e ^ and of then calculating successive 
approximations of A for successive substitutions of t values. We 
shall not take the space to justify the validity of the process in 
this development, and we shall omit the detailed development 
of the series. The following convergent series may readily be 
derived and may be employed to compute areas under the normal 
curve between the mean ordinate (y axis) and any other ordinate. 



To calculate the area A from the mean up to the sigma unit 
t — 2.00, for example, we need only to substitute this value of t 
into the right-hand member of (K), using as many terms as are 
necessary to give the degree of accuracy desired. The student 

^ In making the change, we see that since x/ir “t, x ert, and thus 
dx = <rdt. This accounts for the disappearance of the c in the denominator 
1 


of the factor 
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may easily verify that the area for this value of t turns out to be 
0.47725, approjamately. This means that about 48 per cent 
of the total normal population falls within the range between the 
mean and two sigma units. 

Because of the symmetry of the normal curve, the y axis 
divides the entire area into two equal parts. Therefore, when 
the total area is taken as 1, the proportion to the left of any 


Tablb XXIII. — ^Abeas and Ordinates under the Normal Curve in 
Terms op Abscissas 


Abscissa 

e)' 

(i) 

Area 

between 

mean 

ordinate 
and ordi- 

X 

nate at - 

Area to 
left of 
ordinate 

at ~ 

ff 

Area to 
right of 
ordinate 

at - 

or 

Area 

between 

ordinate 

X 

at — 

<r 

and d — 

Sum of 
areas to 
right of 

+“ and 
<r 

to left of 

X 

<r 

Ordinate 

(.») 

0.0000 

0.0000 

0.5000 

0.5000 

0.0000 

1.0000 

0.3989 

0,5000 1 

0.1915 

0.6915 

0.3085 

0.3829 

0.6171 

0.3521 

0.6745 

0.2500 

0,7500 

0.2500 

0.5000 

0.5000 

0.3178 

1.5000 

0.4332 

0.9332 

0,0668 

0.8664 

0.1336 

0.1295 

2,0000 

0.4772 

0.9772 

0.0228 

0.9545 

0.0455 

0,0540 

4.0000 

0.5000 

1,0000 

0.0000 

0.9999 

0.0001 

0.0001 


ordinate on the right of the y axis may be obtained by adding 
0.60000 to the value of A for that particular ordinate. If the 
ordinate in question lies to the left of the y axis, we must subtract 
the value of A from 0.60000 to obtain the left-hand portion of the 
area under the curve. On the other hand, if we desire the area 
to the right of an ordinate, wo must subtract the value of A from 
0.60000 for ordinates to the right of the y axis and add the value 
of A to 0.50000 for ordinates to the left of the same axis. The 
area between —x/v and ri-a:/or (i.e., between ordinates equally 
spaced to the left and to the right of the mean) is twice the value 
of A. In any case, the proportions cut off by any particular 
ordinate or ordinates can be computed directly from the value 
of ^4. Table XXIII displays areas and corresponding ordinates 
for a few values of the abscissa x/tr. 

All entries in the table have been computed on the basis of 
unit area. If, for example, N == 1,000, then J.,000 times the 
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entries of areas gives the total frequencies for those columns. 
Thus for the case x/o- = 2.00 in a distribution of 1,000 scores, the 
probable frequency between the mean ordinate and the ordinate 
at two sigma units from the mean would be 1,000 times 0.47725, 
or 477.26. This tells us that we should expect approximately 
477 cases out of 1,000 to fall within this range. 

The reader will observe that one-fourth of the total area 
is included between the mean ordinate and the ordinate at 
0.67449 sigma units from the mean; i.e., where a:/<r = 0.67449. 
Multiplying both members by cr, a: = 0.67449<r, the value of a 
deviation which marks off one-fourth of the area — that fourth 
which lies on either side of the mean. Thus we see that half the 
total area lies between deviations which are at a distance of 
0.67449(r from either side of the mean. We may conclude, 
therefore, that, if a deviation is chosen at random from a normal 
population, the chances are even that it will lie ■wdthin this range. 
This range is commonly called the probable error. It is written 

P.E. = 0.67449(r. 

Graduation of Data to Normal Distribution. — ^The problem of 
graduating a given group of scores to a normal distribution 
properly belongs to the study of curve fitting. Nevertheless, 
it is well to consider the problem at this time in order to throw 
further light on the use and interpretation of normal probability 
tables. The task of adjusting a normal curve to a given distri- 
bution is one of passing a smooth curve through the upper 
extremities of theoretical ordinates (those taken from the tables) 
which are found to correspond to actual sigma values of the 
distribution at hand. It is usually advisable to make a list of 
those items which are necessary for purposes of computation 
before plotting the actual frequency polygon and superimposing 
the resulting theoretical curve. The graph itself gives us a 
visual impression of the goodness of fit; but, we are very often 
led to a more statistical test.^ 

The following data for observed frequencies are the scores 
obtained by 149 sophomores at Pennsylvania State College on 
1930 Carnegie Foundation Tests (Professional Education), 
b p. 417 for the x’ test. 
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Table XXIV. — Sophomobe Scores on the Professional Education 
Section op the Carnegie Foundation Tests, 1930 


Score intervals 

Frequency 


319.5-339.5 

3 


299.5-319.6 

5 


279.5-299.5 

8 

1) 

259 5-279.5 

12 


239.5-259.5 

19 


219.5-239.5 

26 

M = 215.4 

199.5-219.5 

22 


179.5-199.5 

IS 


159.5-179.5 

14 

0* « 50.9 

139.5-159.5 

6 


119.5-139.5 

13 


99.5-119.5 

3 



Our problem is first of all to determine theoretical normal 
curve frequencies for the intervals appearing in the table above. 
To do this, -we must find the areas under the normal curve which 
correspond to these intervals and then multiply by 149. We 
simply find the area from the mean up to the upper boundary 
of the interval, and subtract the area which lies between the 
moan and the lower boundary of the same interval. In this way 
we find the theoretical frequencies for all the intervals. 

Consider, for example, the interval (319.^339.5). Since the 
mean is 215.4, the same interval in deviation form becomes 
(104.1-124.1). When we divide by the value of <r (50.9), the 
interval in sigma ufaits becomes (2.04-2.43). From the normal 
probability tables (pages 485 to 487) we find that the area from 
the moan up to 2.43 sigma units is .493, and from the mean up to 
2.04 sigma units is .480. Subtracting, we find the area included 
in the interval to be .013. We conclude that we may expect 
approximately 13 cases out of 1,000 cases to fall within the score 
interval (319.5-339.6). Since in our case N = 149, the pre- 
dicted frequency would be, therefore, .013 • 149 = 1.94, or 
approximately 2. The reader will observe that actually 3 cases 
fell within this group. 

We proceed in this manner to make a table of the gradua- 
tion data for all the intervals. These data are displayed in 
Table XXV. 
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Table XXV. — Nobmal Cueve Graduation Data for 149 Sophomore 
Scores on the Carnegie Foundation Tests, 1930 


Inter- 

val 

bound- 

aries 

Devia- 

tion 

from 

mean 

Devia- 
tion 
in <r 
units 

Area 
up to <r 
unit 

Portion 
of area 
between 

Theoret- 
ical fre- 
quency 

Actual 

fre- 

quency 

Differ- 

ence 

339.6 

-hl24 1 

-i-2.43 

.493 

.013 

2 

3 

-1 

319,5 

+104.1 

-1-2.04 

.480 

.029 

4 

6 

-1 

299.5 

+ 84.1 

4-1.65 

.451 


8 

8 

0 

279.5 

-h 64.1 

4-1.26 

.396 


13 

12 

4-1 

259.5 

-H 44.1 

4-0.86 

.305 

.125 

18 

19 

-1 

239.5 

+ 24.1 

4-0.47 

.180 

.149 

22 

26 

-4 

219.5 

+ 4.1 

4-0,08 

.031 





215.4 




.165 

23 

22 

+1 

199.5 

- 15.9 

-0.31 

.124 

.134 

20 

18 

+2 

179.5 

- 35.9 


.268 

.106 

16 

14 

+2 

159.5 

55.9 

-1.10 

.364 

i 

i .068 

10 

6 

+4 

139.5 

- 75.9 

-1,49 

1 

.432 

.038 

6 

13 

-7 

119.5 

- 95.9 

-1.88 

.470 

.018 

3 

3 

0 

99.5 

-115.9 

1 -2.27 

.488 






The area for the interval which included the mean 
(199.6-219.5) 

was obtained by adding the areas from the mean out to either 
extremity of the interval. The Difference column in the table 
may be used to make rapid adjustments in the frequency polygon 
and thus to give the points through which the smooth theoretical 
curve is to be drawn. 
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Figure 21 shows the frequency polygon of the sophomore 
scores together with the superimposed theoretical normal 
curve. 

The Ordinates Method. — The normal curve of Fig. 21 was 
drawn through the points that represented the theoretical 
frequencies in each interval. Another very simple method of 
plotting the curve is to erect ordinates at given distances along 
the X axis and to pass the curve through the upper extremities 
of these ordinates. Usually the practice is to start at the mean 
and erect an ordinate at each half sigma in each direction until 



Fig. 21. — Normal-curvo graduation of 149 sophomore scores on the Carnegie 

Tests, area method. 

five or more ordinates are found on either side of the mean. 
With the frequency polygon already drawn on a scale that is 
marked off along the r axis for scores and on the y axis for fre- 
quencies, it is easy to determine gi’aphically where the ordinates 
should be erected. The method is simply that of graphing the 
equation of the normal curve, which we have seen (see page 286) 

may be written y = ~ z. 

In our problem N = 149, and in terms of intervals 
ff = (50.9 20) = 2.6 

W <r — 149 2.5 = 59.6. The equation whose curve we 

wish to plot may thus be written y = 59.6«. The value of z 
for each value taken along the ar-axis may be calculated by 



logarithms from the equation z sa (l/\/2ir)e or more easily 
from our z table, ‘ The normal-curve ordinates at the mean, 


‘ Appendix, Table XLIV. 
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±0.5a-, ±1.0<r i: 1.5<r, +2.0<j', +2.5a-, and ±3.0<r for our problem 
are as follows; 


xjff 

2 

y = ( 59 . 62 ) 

0 

0.3989 

23.77 (mean ordinate) 

±0.6 

0,3521 

20.98 

±1.0 

0,2420 

14.42 

±1.5 

0.1295 

7.71 

±2.0 

0,0540 

3.21 ‘ 

±2.5 

0.0175 

1.04 

±3.0 

0.0044 

.26 


The frequency histogram representing the 149 scores on the 
Carnegie Foundation Tests and the normal curve plotted by the 
ordinates method are shown in Fig. 22. 



Fig. 22. — Normal curve graduation of 149 sopliomoro scoroa on. the Camegio 
Tests, ordinates method. 


Goodness of Fit. — ^The use of chi square in testing goodness 
of fit of the normal curve is illustrated in Chap. XIV. Another 
test of normality developed recently involves the ratio of the 
mean deviation to the standard deviation.’- Geary gives a table 
of average ratios to expect for different re's and also for the highest 
and lowest in 1 per cent and in 5 per cent of the samples. He 
also gives the standard error of these ratios which he calls w». 
Concerning the use of this ratio as a test of normality Geary 
says: 

Prom this investigation it appears very likely that, for qtute amplt 
samples draivn at random from a normal universe -with mean zero, the 
distribution of w* is fairly close to normal . . . The advantages of w*, 
regarded as a fimction of the original variables x, are as follows: like it 

Gbabt, R. C., “The Ratio of the Mean De-viation to the Standard 
Deviation as a Test of Normality,” Biometrika, Vol. 27, pp. 8ia-.832 (1985). 
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assumes a characteristic value for infinite normal random samples; the 
values of its semi-invariants indicate that its distribution is far closer to 
normal, even for moderate samples, than that of and ... its 
frequency distribution can be determined for aU normal samples. Its 
principal disadvantage is that it is not symmetrical in the original 
variables ... It would seem advisable to randomize the sample a few 
times and to calculate con for each permutation. The mean or the 
median con might then be taken as the representative value for the pur- 
pose of determining the probability of normality. 

For the distribution of oin (A.D./cr) Geary employs the same 
technique as Student for t and Pearson for x^ joint proba- 
bility. He gives tables for the mean value to be expected, for 
<ra>«, and for the upper and lower 1 per cent and 5 per cent values. 
He holds that even for quite small samples from a normal dis- 
tribution the distribution of ccn will not be far from normal. 
The probability points of con for the upper and lower 1 and 5 per 
cent levels, the mean of con, and the standard deviation of con are 
given in Table XXVI for different values of iV — 1, labeled n. 


Table XXVL — The 1 and 5 Per Cent Probability Points of «« 



Upper 

Lower 

Mean of 

COn 

Standard 
deviation 
of cpft 

1% 

6% 

5 % 

1% 

5 

.980 

.954 

.696 

.626 

.8386 

.0786 

10 

.941 

.911 

.710 

.656 

.8180 


15 

.910 

.891 

.720 

.677 

.8113 


20 

.902 

,879 

.728 

.691 

.8079 


25 

.892 

.870 

.734 

Ml 

.8059 


30 

.884 

.864 

.739 

mm 

.8046 


35 

.878 

.869 

.743 

.715 

.8036 


40 

.873 

.856 

.746 


.8029 

.0328 

45 

.869 

.861 

.749 

.725 

.8023 


50 

.865 

.849 

.761 

.728 

.8019 

.0295 

75 

.863 

,839 

,759 

.741 

.8005 

.0242 

100 

.846 

.834 

.764 1 

.748 

.7999 


600 


,814 

.783 

.776 

.7983 


1,000 

.813 

.809 

] 

.787 

.782 

.7981 

1 



For the data of Table XXIV n « 148, a « 60,9, and 
A.D. = 40.3* 


« A.D./<r = 40.3 50.9 « .7917. From Table XXVI we 
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see that this value is withiu the 5 per cent level for an n between 
100 and 500 and is very close to the mean Un to be expected. 
On the basis of the Geary test we would conclude, therefore, 
that the sophomore scores on the Carnegie Foundation Tests 
are distributed normally. This agrees with the test of good- 
ness of fit discussed on page 418. 

APPLICATIONS OF THE NORMAL CURVE CONCEPT 

The normal curve is put to very many uses in educational 
and sociological research, some of which are discussed and 
illustrated at length in the elementary texts. To ask what use 
can be made of such a concept as that of normality of distribu- 
tion is much like asking what use can be made of a lathe. A 
lathe is a tool which weean employ in making all sorts of products, 
according to our needs in the particular ejdgency; and the same 
is true of statistical formulas, including the normal curve func- 
tion. Nevertheless we shall list a few of the types of uses to 
which the normal curve function has been applied, describing 
them here very briefly and recommending further reading in the 
sources, or in the more elementary texts, for students who wish 
to pursue the matter further. 

1. To assign difficulty values to questions in a test. As 
questions become increasingly diffiicult a larger percentage 
of pupils fail them, the percentage increasing slowly at first, 
rapidly around the middle difficulties, and then slowly again at 
the upper extreme. Difficulty values are assigned in terms of the 
distance along the x axis from the mean or from some other zero 
point to the ordinate which divides the proportion that succeeded 
with the question from the proportion that failed it.^ 

2. To assign difficulty values to different scores on a test. 
The technique is essentially the same as that involved in the 
paragraph above, except that the ordinate is located by the 
proportion made up of those who earned a lower score than 
the one in question plus half those who earned the same score.* 

3. To set standards for the distribution of grade marks. For 
this purpose the base line of a normal distribution is marked off 
into as many equal divisions as there are steps in the scale of 

^ WooDT, CLirroKi), MeoBurenent of Somt Achievements in Arithmetic, 
Teachers College Bureau of Publications, Columbia University, 1916. 

* McCall, W. A., How to Measure In Education, The Macmillan Com- 
pany, 1922, p. 278. 
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grades and the area of each of these divisions is taken as norm 
for the percentage of individuals to receive the corresponding 
mark. Sometimes the base line is cut off at a range of five sigmas 
and sometimes a range of six sigmas. 

4. To indicate the numbers of pupils to be expected in each 
division when desiring to divide pupils into ability groups of 
equal range of talent. The technique is the same as under 3. 

5. To transmute marks distributed according to different 
standards of leniency. Suppose a teacher gives 20 per cent of 
his students A, 40 per cent B, 30 per cent C, 8 per cent D, and 
2 per cent E. By use of formula (168a), a difiiculty value for each 
of these grades and a comparison with the difficulty of correspond- 
ing grades by other teachers may be determined, and, if desired, 
all grades may be transmuted to the same standard. To make 
such computations is left as an exercise for the student. 

6. To make scales for measuring the merit of handwriting, 
drawing, English composition, etc. For this purpose specimens 
of these objects are ranked into overlapping distributions 
and scale values determined from the mean of one of these 
distril)utions to the moan of the next. Thux'stone has recently 
extended and improved upon this technique in making attitude 
scales. His essential addition consists in taking the c of one of 
the distributions as standard and stating all steps in terms of 
this standard, thus securing more consistent units than by the 
older method.^ 

7. To make scales for measuring the mores of society, and to 
measure deviations from morality.^ 
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CHAPTER XI 

THE CORRELATION RATIO 
CURVILINEAR CORRELATION 


When we treated standard error of estimate (pages 112 to 117), 
we found that <reat^ = <ry\/i — rly. This standard error of 
estimate we saw to be the standard deviation of one of the 
columns of the correlation table, on the assumption that all the 
columns have the same standard deviation. We may denote it 
cTc as well as Using this notation, squaring, and proceeding 
with several other algebraic transformations, 


= 0^(1 — rlj,) = -■ o-Jrlj,; 



^ crl -- 



Thus an r could be computed in terms of the standard devia- 
tion of a column and the standard deviation of the whole distribu- 
tion. The r is, thus, determined by the extent of the scatter 
of the columns in comparison with the extent of the scatter in 
the whole distribution. However, oi mtist be calculated from 
the regression line as origin, and this cannot be done in advance 
of a knowledge of the r itself. But we can got a convenient meas- 
ure of relationship by giving up the demand that <rc be computed 
from measures taken as deviations from the regression lino and 
by letting^the measures from which it is computed be deviations 
from the mean of the column. The value of our correlation will 
not now be quite the same, so we must employ a new symbol 
for it. 


Vyx 



(Correlation ratio) (173) 


This coefficient, eta, may include the case of cundlinear correla- 
tion. It gives us a measure of the extent to which the y scores 
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for each given x value are grouped compactly together and, 
consequently, indicates the degree to which some law is present 
in the relation between the x and the y factors, but the line of the 
means may become a nonrectilinear one. Hence we may not 
use ri in the simple regression equation developed in connection 
with r, for that is an equation for a straight-line relation. The 
accompanying correlation tables, shomng for pupils in two grades 
of the rural schools of Centre County, Pa., the relation of scores 
in the Otis Classification Test to pupils’ ages, depict this sort of 
situation. It will be seen from the foimula that 17 varies between 
0 and 1. For, if there is no scatter of the columns at all, so that 
all y scores for a given x value come at exactly the same point 
showing complete determination of y values by x values, cf = 0, 
the value under the radical becomes 1, and its square root is 1. 
If there is no law operative, so that scores in each column scatter 
as widely as the whole distribution does, = o-J, and we have 
under the radical 1 — 1 -= 0, so that rj = 0. ij can never be 
negative, since its only function is to show the degree of the pres- 
ence of a law — and that degree can run only from none to com- 
plete. But 77 will always be exactly equal to r (in the case of 
complete rectilincarity) or greater than r — never less. This is 
because a standard deviation is always the least possible when its 
deviations are taken from the mean of its distribution, as they are 
in the case of 77. Thus of taken from the regression line, which 
lies outside the mean of at least some of the columns except 
in the ease of strictly rectilinear regression, is greater than<r^. 
Hence less is subtracted from the 1 under the radical in the 77 
formula, and, consequently, the 77 is greater than the correspond- 
ing r. 

In practice the formula for 77 is usually put into a different 
form from that given above. To get it into the conventional 
form, we shall square it and carry it through a simplifying process. 


Vyx 






The mean of a column lies at a distance of d, we shall say, 
from the mean of the whole distribution. If our measures are 
in deviation form, this d will equal, of course, where n, 

is the number of cases in the column in question. Then for any 
one column, taking our measures as deviations from the mean 
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of the whole y distribution as said, 



Summing for all the columns weighted for frequency and dividing 
by the sum of the frequencies, 

_ S(2y®) Sn„(Syc/n.)' 

N ~ N N 


If we make the assumption of homoscedasticity this becomes 

N N jv" ' ^ ”« 

Making in tke i;® formula above the substitution of the value just 
shown, we have 

2 

Vux — ~T) %» = — ‘ (Second form of the correlation ratio) (174) 

ffy <Xy 


Thus T] equals the standard deviation of the means of the 
columns divided by the standard deviation of the entire distribu- 
tion. The formula for the regression of x on y would obviously 
be Vxv = <rmj<rx, w'here, of course, in the former case the columns 
for which the standard deviation of means is taken are columns 
of y values for particular values of *, while in the latter case they 
are columns of x values for particular values of y. 

The formula for ij is frequently employed in just the form given. 
But we can put it into a more convenient shape and can pair it 
with a formula for r for the same data, by a little algebraic 
transformation. 

The mean of any column is where no is the frequency for 

that column. We wish to find the standard deviation of the set 
of means involved in all the columns. We shall employ the 
formula for with zero as the assumed mean, which is 



But instead of aggregating the moments as we go, we shall let 
them stand in the formula as they result from each of the separate 
columns. Our frequencies for the successive columns, 0, 1, 2, 
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3, . . . , we shall represent by no, ni, nz, .... Our moments 
must, of course, be weighted by these frequencies. Our standard 
deviation squared for the means of the y columns will be, then, 

+ ■ • ■ ]”(^) 

The N refers to the total population in contrast with the n’s of 
the several columns which refer to the populations of their 
respective columns. We may now combine the n's with the 
quantities in parentheses and have 



The sigma of the whole set of 2 /’s, which we need in squared 
form for our denominator, is given by the familiar formula 



Substituting this value for <tI and then multiplying bothnumerar 
tor and denominator by wc have, for 


% 


- 


'^0 

Wo 


+ 


4- 

ni 




+¥+ 

nz 


) 




Nliyl - liyif 

(Third formula for 17 *) (175) 


Note that this is 1 ?*. Do not forget to extract the square root. 

Now we can nicely pair a formula for r with this one by merely 
summing our xy values by columns and letting these partial 
sums stand in that form in the formula. We shall make zero 
our assumed mean in respect to both arrays; so our x values 
will be, successively, 0, 1, 2, 3, etc., up to one less than the number 
of columns. Of course, the formula would be essentially the 
same if we took some other assumed mean than zero, only then the 
partial sums would have the minus sign at the left of this assumed 
mean and the plus at the right. With these paired formulas we 
can easily get both ij and r from essentially the same operations, 
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only a few extra minutes being required to get either one when 
the other has been computed. The following is the r formula: 

N{1,yx + 22^/2 + 3 21/3 + 42y« +•••)- Sxat • 2yy 

V{Nlyl - 2i^y^24 - ^l) 

(Formula for r paired in 
structure with tho eta (176a) 
formula) 

The P.E. of 71 is usually given as 

P,E., - .6745 

y/N 

We shall now apply these two paired formulas to the computa- 
tion of 71 and r for the data of Table XXVII and present similar 
data for another grade for comparison and as an exercise for the 
reader. The data are scores on the Otis Classification Test 


Table XXVII. — Scores on the Otis Classification Test by Children 
IN THE Eighth Grade of the Rural Schools of Centre County, 
Pa., Distributed According to Chronological Age 


Score 

Chronological age; ycars-months 

1 

B 



10 to 
10-11 

11 to 
11-11 

12 to 
12-11 

13 to 
13-11 

14 to 
14-11 

16 to 
15-11 

16 to 
16-11 

140-149 


1 






1 

12 

12 

144 

130-139 




1 

1 

1 


3 

11 

33 

363 

120-129 



3 

2 

1 

2 


8 

10 

80 

800 

110-119 



2 


4 



6 

9 

54 

486 



■1 

4 

4 

6 

4 


22 

8 

176 

1,408 

90- 99 



3 

8 

8 



21 

7 

147 

1,029 

80- 89 


B 

— 9 

JZ 

B 

2 


29 

6 

174 

1,044 

70- 79 

2 

|R| 

4 

13 




46 

6 

230 

1,160 

60- 69 

/ 


8 

11 



. 1 

37 

4 

148 

692 

60- 69 

1 

4 

6 


9 

N 

40 

3 

120 

360 

40- 49 

1 

2 

3 

4 


10 


23 

2 

46 

92 

30- 39 

1 

1 


2 


2 

2 

9 

1 

9 

9 

20- 29 





2 

2 


4 

0 

0 

0 

Totals. . 

6 

20 

‘ 40 

68 



4 



1,229 

7,477 

SF. 

16 

no 

226 

298 

383 

189 

8 

1,229 

■ 




61 

606 

1,266 

1,631 

1,930 

777 

16 


■ 



X 

0 

1 

2 

3 

4 

5 

6 


■ 



sx 

0 

20 

80 

174 

304 

230 

24 


■ 




0 

20 

160 

622 

1,216 

1,160 

144 

3,212 

1 
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made by pupils in the rural schools of Centre County, Pa., in 
1928 in the eighth grade and in the sixth grade. The scores are 
distributed according to the chronological ages of the pupils, 
and our problem is to find the correlation between the ages and 
scores within a single grade range. 

The summation of the y moments by columns, Sj/o, is obtained 
in precisely the same manner as in the Pearson product-moment 
method of correlation described in Chap. IV. Here, as there, the 
sum of the y moments by columns equals the sum by rows, so 
that we have a check on the correctness of the work. That sum 
in this problem is 1,229. Applying our formula, we have 

5 _ 249(51 -b 605 -t- 1,266 -f 1,531 -f 1,930 -f 777 -f- 16) - 1,229* 

249(7,477) - 1,229* 

= .0772 


Taking the square root, r]yx = -277 • • • 

249(110 -h 2 ■ 225 -b 3 • 298 + 4 • 383 + 5 • 189 •+• 6 • 8) 

- 1,229 • 832 

^ ■ 7,477 - 1,229*) (249 • 37212 - 832*) 

= -.163 


Tab^b XXVIII. — SootiBS ON THE Otis Classification Testbt Children 
IN THE Sixth Gbadb of the Rural Schools of Centbb County, 
Pa., Distributed According to Chronological Age 


Scores 

Chronological age; years-months 

Totals 

9 to 
9-11 

10 to 
10-11 

11 to 
11-11 

12 to 
12-11 

13 to 

1 13-11 

i 

14 to 
14-11 

15 to 
16-11 

110-119 


■ 

1 

1 

■ 

m 

■ 


100-109 

1 

■■ 







90- 99 



1 

3 





80- 89 


3 

3 






70- 79 


4 

10 

4 

Hi 




60- 69 


4 

13 

7 

Hi 

1 



60- 69 

2 



8 


2 

^HH 


40- 49 



15 


mm 

2 

H 

44 

30- 39 

^ . 

8 

11 

11 i 

msm 

5 



20- 29 

4 1 

3 

7 

14 

6 

4 



10- 19 

j 

3 

3 

n 

4 

3 



00- 09 


1 i 

2 


1 


■1 


Totals 

13 

88 

84 

64 

38 


6 

260 
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It will be observed that the ri is larger than the r, as we said 
above must be the case whenever they are not identical \vith each 
other. Also the rj is positive, while here the r is negative. An rj 
is always positive, since it indicates only the extent to which the 
columns are shortened in comparison with the total distribution 
and hence the extent of the operation of some law causing the y 
scores to be more or less definitely placed for given values of x. 
What that law is we can know only by a further examination 
of the trend, while r indicates both the extent of the law and the 
direction of the trend. 

The probable error of our rj is 

P.E., = .6745 ^ = .058 

V24:9 

Since rj is nearly five times its probable error, it is clear that a 
law is operating to place y scores in terms of x scores; i.c., there 
is a correlation between scores and chronological age within this 
eighth grade range. 

Applying the same two formulas to Table XXVIII rj turns out 
to be ,222 and r to be —.154. The two grades show, therefore, 
very consistent results. 

Hitherto the chief use made of tj was to test rectilincarity of 
regression. The regression lines in Tables XXVII and XXVIII 
are both curved. Is that due merely to chance sampling or is 
there a significant departure from rectilinearity which may bo 
expected to persist with successive sampling? The extent of 
departure of rj from r is a function of the departure of the regres- 
sion from rectilinearity. It has been customary to test the 
significance of this departure by applying Blakeman's test of 
significance of — r®). In the previous edition of this book 
we explained that test and applied it to Tables XXVII and 
XXVIII. But we found it to give results which were not plaus- 
ible. The inadequacy of the Blakeman test is now recognized, 
and we are dropping it from our treatment here. Instead, we 
recommend applying the test of goodness of fit to test the 
significance of the departure of the actual regression from recti- 
linearity. Fisher^ gives a value for x^ which, for the straight line 

^ Fishbr, R. a., ^^The Goodness of Fit of Regression Formulae/^ Boy^ 
Statistical Soc., Vol. 86, Part IV, pp. 697-612 (1935). (The distribution is 
not quite the conventional one for x®, though close enou^ for large samides. 
For small samples Fisher gives a correction.) 
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as the theoretical value, reduces to 
2 2 

— (N — k) I ' _~2 (x“ ia terms of and r*) (176) 

In this the N is the population of the sample and k is the number 
of columns. The result is interpreted in the manner explained 
on pages 410 to 419, with the aid of Table XLVII, page 498. 
The X® table must be entered with n — (k — 2) oi n' = (k — 1). 
The value of x® calculated by this formula for Table XXVII is 
13.26. Entering the table of x* values with » = (7 — 2), which 
is 5, we find that a x* of 13 shows a P of .023379, and x* of 14 
shows a P of .015609. Linear interpolation between these for 
X® = 13.26 gives P = .021359. The probability is, therefore, a 
little more than .02 (two chances in a hundred) that a discrepancy 
as great as the one obtained in this problem might arise as a 
matter of chance fluctuation even though the true regression were 
rectilinear. That would leave the hsrpothesis that the regression 
might be rectilinear not wholly refuted, though rendered rather 
untenable. The fact, however, that a second sample shows a 
departure from rectilinearity in the same direction (both regres- 
sion lines having the same general shape) further weakens the 
hypothesis that the true regression line might be rectilinear. The 
first sample alone gives a fairly significant (beyond 5 per cent), but 
not highly significant (1 per cent or less), difference from recti- 
linearity; but the two samples jointly give highly significant 
evidence of the curvilinearity of the regression.* 

A CORRELATION RATIO WITHOUT BIAS 

Unfortunately ?j is affected by the number of items in the 
several classes as well as by the inherent extent of correlation. 
For, as we saw on page 69, the variance of a class shrinks more 
and more, compared with its true population value, as the n 
decreases. In the numerator of the fraction in the formula, * 

(A) = 1 - 4 

the true population value would, on the average, be ndoi/irio — 1), 
whole that of the denominator would be jy _ ■ a|. Because «« 

* On p^e 827 we give a better test for the goodness of fit of regression 
lines. 
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is not equal to N, the value of the fraction and, consequently, 
the value of t?® will be affected by the population of the sample, 
or by the number of classes into which the total population is 
divided. In order to get a correlation ratio independent of this 
disturbance, Kelley^ developed recently a new formula for the 
correlation ratio, which he designated e. 

If we employ population variances instead of sample variances, 
the estimates of the variances will not be altered by reason of 
smaUness of populations in the columns, or in the whole y dis- 
tribution, because our method of estimating population variances 
takes care of that. We learned on page 70 how to substitute for 
sample variance an estimate of the population variance: wo 
need only divide our sum of squares by (N — 1 ) instead of by N. 
Or, if we already have v*, s® (the estimate of the population vari- 
N 

ance) is merely So instead of in the 17 formula we 

N 

need only to use numerator we need the 

population variance of the o^’s. If our assumption of homo- 
scedasticity were met perfectly, we could get that by merely 

taking ^ vl where (r® is computed from any column. But 

we shall do better to estimate the population variance of the col- 
umns by taking a weighted average from all the columns* Let- 
ting stand for an estimate of the population variance of a 
particular column and letting be the number of items in that 
column, 



Clearing of fractions, 

(no, - l)s®, = nc,< 7 ®, 

Summing for all the columns, 

k h 

(no, — 1)^, = ^ 

where h is the number of columns, n<i, stands for 4 he population 

of any column by which the vf/s are to be weighted, and the 

iKbuubt, T. L., “An Unbiased Correlation Meaatire.” Proc. Nat, Acad, 
Sd., Vol. 21, pp. 654-659 (1936). 
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symbols above and below the S indicate the limits of summation. 
Assuming homoscedasticity for the purpose of estimating the 
population variance for the columns, but retaining on the right 
differing v® values and weighting them for their population 
values, and dropping the j subscripts, 


(Sn* — k)sl = Sncff®; whence s® = 


Substituting these two estimates of the population variances in 
Eq. (A) and using 6* to designate the estimate of (for we can 
never know ij, the true population ratio, but only estimate it), 


Snoff® 

N -k - 1) 

Nffl ~ ^ N4iN - k) 

N - 1 

(Correlation ratio without bias) 


(177) 


The elements of this formula can readily be computed from 
the squares of deviations from the means 

SncorJ = S2(j/c — ycY; Na-l = x(y — gy 

Or they can be computed from the scores by the following 
equivalent formulas: 


Snco^ = (sy* - 2-^'); N<rl = (sy* - ^ 


Or, if ij® has already been computed, we may substitute it 
in formula (177) and get in terms of tjK Preserving the 
weightings of the variance of the columns for the differing 
populations of the columns, 




Sno(^ 


,® = l-^;whence^ = l-,^ 


and from the above e® 


N -1 
iVo® ■ iV - ft’ 


1 - 


«® « 


(N - l)»j® - (ft - 1 ) 
jfZTk 


k)-(N-l) + {N- l)ij® 
(«* in terms of 7 *) (178) 
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If we substitute zero for e* in formula (178) we shall get a value 
for the average 17^ when the true rj is zero. Calling this 17®, 

~ - l)’?o = ('I; - 1) 

2 _ fc — 1 _ j k — 1 (Tlie average vahie of 5 

’Jo ~ jy _ VO — •Wjy _ j when the true ij is zero) 

Since <r® is always less than o| and since 970 could ext.romoly 
rarely be expected to be exactly zero, it is easy to see why 17 
should tend to have a slight positive bias. Kelley’s formula 
corrects for this. 

Besides the constant positive bias in 17, there is a second 
disturbing factor for which the « teclmique corrects in ])art but 
for which a further correction is needed; i.e., the dopcudcuice of 97 
upon the number of classes into which the x distribution is 
divided. One reason why 17 with a large number of categories 
differs from the value in the same situation with a smaller number 
is that with the larger number the populations in the several 
classes are lessened. If there were as many classes as the total 
number of items N, 17 would necessarily be unity; for with a 
single item in each column the variance of the column would bo 
zero. But in the total population, which is hypothetically 
infinite in size, the variances would remain the same regardless 
of the narrowing of classes, because the populations in the classes 
would still be infinite. Thus to the extent to which e overcomes 
the effect of smallness of populations in the classes, it corrects 
for differing numbers of categories. In the direction of fineness 
of grouping this constitutes the necessary correction. But in 
the direction of broad categories a cUsturbing factor still remains. 
If a category is broad enough to combine within it a number of 
elementary classes, the means of these several elementary classes 
will differ from the mean of the combined elementary classes 
to the extent to which there is present regression which differs 
from zero. Thus the variances of the broad classes will be some- 
what too great as compared with the variances of the constituent 
elementary classes, and e from broad categories will be somewhat 
too low. But a satisfactory correction for this is easily made. 
If it is assumed that, within each broad class, the regression is 

rectilinear and the slope is represented by ± « — » exactly the 
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same technique may be applied as that employed for correcting 
rectilinear correlation for broad categories, described on pages 
393 to 399. This assumption is not strictly true, but it is the 
best simplifying assumption that can be made^ and is correct 
to a good degree of approximation. On this assumption the 
correction involves merely dividing the obtained e by the product 
of the r^s between index values and variates in each of the arrays, 
which r’s are tabled on page 398. 

— t — (g corrected for broad categories) ( 180 ) 

We shall now apply these two corrections to the rp computed 
for Tabic XXVII, page 316. First the correction for bias is as 
follows; 

, __{N - 1 ) 17 “ - (fc - 1) _ (249 - 1)(.0772) - (7 - 1 ) 

* {N -k) (249 - 7) 

= .0544 

€ = .233 


To coiTect for broad categories we must divide the e obtained 
above by the product of the r^s between index values and variates 
for each of the two distributions. These depend upon the 
number of categories and the assumed shape of the distributions. 
Both the distributions as to age and as to achievement are 
approximately normal, so we use the third column of r's in the 
table. For ages the number of categories is 7, and the coi> 
responding r between index values and variates in the row for 
7 categories is .970. In respect to achievement there are 13 
categories, for which the tabled r is .991. Dividing by the 
product of these two r's, we have 

’ .233 0/10 

~ (.970) (.991) “ 


This corrected e has a standard meaning, free from bias 
and independent of the size of the population of the sample and 
of the number of classes into which the sample is divided. In 
this form it is free from the objections on account of which 

1 This is the same assumption that is made by Studidnt in deriving a 
different formula for correcting i; for broad categories. Stodunt, “Correc- 
tion to Be Made to the Correlation Ratio for Grouping,” Biometnka, Vol, 9, 
p.317. 
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Fisher dismissed ry as of ^‘extremely limited” utility.^ Thus 
corrected € should have a wide and important usefulness in 
statistical research. We show below that it has all the merits of 
Fisher^s analysis of variance technique and has, besides, a con- 
structive meaning which makes it a positive rather than a 
merely negative utility. 

In the article previously referred to, Prof. Kelley derives a 
formula for the standard error of and of e. 


(Tea 


■s/N - 1 L * 


ill 


(Standard error \ 

ofe^) 


■which holds when 1/JV is not small in comparison with 

(Standard error (ig2) 

2e^N -ll N -k ^ J oie) ^ 


which is satisfactory if e is not small. 

The interpretation of the values obtained from the application 
of these formulas requires a knowledge of the form of the dis- 
tribution of samples around any hypothetical true value of the 
statistic. At present we do not know that distribution (except 
as treated in our next paragraph). If the correlation is not 
very high and the population reasonably large, we may take 
the distribution to be normal, with little risk of appreciable 
distortion in our interpretation. We raise that question of 
distribution in our next paragraph. The reader may wish to 
compare the outcome from the technique of our next paragraph 
with what he would get from formula (181) on the assumption 
of a true value of aero for and the use of the table of the normal 
distribution. 

Testing the Null Hypothesis. — ^Frequently we wish to know 
whether any law at all is present or whether the e we have from 
our sample might reasonably have arisen merely by chance 
fluctuation in sampling. For this purpose we need to know 
the distribution of when the true correlation is zero. We have 
made tables for this distribution which are presented on pages 
494-497 of this book. To test in this way the e® of our illustra- 
tion, we enter our table with (fc — 1) equals 6, (W — k) equals 242. 
We do not find there a row for 242, so we shall interpolate between 

^ Fisbkb, R. a., StaHtUcdl Methods for Research Workers, 7tli ed., p. 264. 
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the rows 200 and 400. In row 200 and column 6 we find .032 
for the 5 per cent point and .052 for the 1 per cent point. In row 
400 the values are .016 and .027. Interpolation gives .029 and 
.047. The e® in our illustration is .054, which is larger thnn 
even the one which stands at the 1 per cent point. This m^ang 
that, if there were no law relating educational score to age within 
a single grade, we would get such a large considerably less t.bn.Ti 
1 time in 100. The null hypothesis is, therefore, disproved; it 
is highly probable that there is some law relating educational 
achievement score and age within a single grade, and the extent 
of this law is expressed by a correlation ratio of .242. To 
determine what is the character of that law should be the next 
step in our research with these data. That step would be curve 
fitting, which we discuss in Chap. XV. 

On a later page (337) we give data which are there employed 
to illustrate analysis of variance. Those same data can easily 
be worked up into e®, as follows: 



= 1 


44,390 
154,420 “ 


.287 = .713 


Here (k — 1) is 4 and {N — k) is 25. Entering our table with 
these n’s we find an e® of .195 at the 5 per cent point and .305 at 
the 1 per cent point. Our obtained e® is much greater than even 
the 1 per cent value, which means that, if there were no law 
present, so large a value would be obtained much less than 1 Hma 
in 100. This is entirely consistent with the showing by the 
technique of analysis of variance, as reference to page 338 will 
show. In fact, the test by the epsilon technique and the analysis 
of variance technique will always give precisely the fiamPi 
results. Thus we see there is a law relating breed of cattle to 
milk production and the extent of this law is expressed by the 
correlation ratio .845, the square root of e®. What the law is 
must be determined by comparing means and variabilities of 
production among the breeds with large samples and controlled 
conditions. Whether or not for this test 6® should be corrected 
for broad categories depends upon whether the classes are con- 
tinuous and arbitrarily divided into classes or whether they may 
be more sensibly regarded as centering around point values. 
The former of our illustrations undoubtedly involves the former 
character, while the second is probably of the latter class. 
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THE PARTIAL CORRELATION RATIO 

An y formula for partial rj in. terms of lower order correlations 
would, either demand that we know and apply the equation of 
the regression curve, which would be too cumbersome to bo 
practical, or that we make assumptions about this curve which 
would be too hazardous to risk in practice.^ But a partial 
correlation ratio can be determined by selection. Suppose we 
have, in a large population, scores on general intelligence (x), 
high-school scholarship (z)j and academic success in college (?/), 
and we wish to know the correlation ratio between high-school 
scholarship and college success with the general intelligence 
factor held constant. We can sort our individuals into clasvses 
on the general intelligence (x) factor, then subsort these classes 
according to high-school scholarship (z). After both x and z 
are thus held constant, these subclasses will still have a certain 
variance due to factors other than x and z. 

If we denote the weighted average variance of tho subclasses 
by and that of the x classes by cr% then by definition of the 
partial correlation ratio. 


Vyz*c 



(Partial 77*, y on z with 
X held constant) 


( 183 ) 


For partial epsilon this would be 

2 _ 1 — k) 

^ - kp) 


(Partial e*, y on z with 
X held constant) 


( 184 ) 


where k is tne number of classes into which the population is 
sorted on x, and p is the number of classes into which each x class 
is subsorted. One could get a tentative idea of the extent of the 
partial correlation by determining the variance of one sample of 


^L. Isserlis derived such* a formula: “The Partial Correlation Ratio/' 
Biometrika, Vol. 10 , pp. 391 - 411 . In spite of the title, the Isserlis formula is 
for multiple eta instead of for partial eta. But it can lead into the latter by 
substituting the value found for multiple eta [Fyo,*)] into the formula: 
vl*,x — — i7j«)/(l — ^J*). But the derivation assumes that the 

regression oi y on x for z constant is rectilinear and also that of « on y is 
rectilinear for x constant. These are too hazardous assumptions for refined 
practice. 
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y scores from a single x class and then drawing from this a sub- 
sample for a single z value and computing the variance of this 
subclass. The partial correlation ratio would be, so far as this 
meager trial could suggest, the square root of the difference 
between these two variances divided by the variance of the 
X class. This would 3deld more valid results to the extent to 
which the average from a number of subclasses was employed 
rather than a single one; and, of course, for a good determination 
the values should be summed over the whole table. With the 
Hollerith machine equipment this should not be a very diflScult 
process. 

TESTING THE GOODNESS OF FIT OF ANY REGRESSION LINE 

In terms of e** we can easily make an “exact” test of the good- 
ness of fit of any regression line. This parallels the x® test on 
page 319 but is a more precise one and applies not only to a 
rectilinear regression but to regression lines of any shape. We 
said that, after having found by the correlation ratio technique 
that some law is present in our data, our next concern would be 
to investigate the nature of that law. One method of doing this 
is to seek the curve that best fits the trend. The technique of 
curve fitting is considered in Chap. XV. Having fitted a 
promising curve, we would next wish to test mathematically the 
goodness of the fit and hence the appropriateness of the type of 
curve fitted. Our formula for doing this is derived as follows: 

Refer again to such a layout as that of Table XXVII, page 316. 
Conceive of a new set of derived values, y', each of which is 
the original value taken as a deviation from the point on the 
regression to which its column belongs. These derived values 
would make a new table of columns with a new set of means 
fluctuating about a line of zero slope. For this derived table we 
can have a new correlation ratio, 

(i) = 

The variance of each new column will be the same as before, 
since there is no change except that a constant has been sub- 
tracted from all the scores, which does not affect .the variance. 
But ^ will diff®r from , We must find a value for In 
a given column, if is the value of the point on the regression 
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line in terms of deviations from the whole y mean, 


y. = y'i + Jx, Vi = yp + Jl + 2y-/i; 

M = M' + ^ + 2 

Wo, nc^ Ue^ 


Summing for all the columns weighted for their frequencies and 
dividing by the sum of the weights, 


Sys _ V , ^ 

N ~ N ^ N 


+ 2 


SSyJJi 

N 


But, if the regression line is the best-fit one, the last term above 
will sum to zero over the whole sample, or substantially so. 
Therefore, 

<4 = -A-nd, transposing, o-®' = <rj — o-J 

Multiply through by iV/(iV — 1), 

iO) ■ 4’ = 4- <^5 


Now define a new term, so that == crj/crj, whence 

<r5 = 22VJ = B* 4 . 


Substituting in (<7), 

^ = s* - 22*8® = s*(l - 12*) 

Substitute this value in (B), 

= 1 _ ^ 1 
^ ^(1 - 22*) ^(1 - 22*) J 

I^Tb* (1 - “ I) 

- ^ Z'- R* -I. 1 - -K* 

~1-B*V 4/ ~ 1 - B* 

Therefore 


B* 
1 - ft* 


( 186 ) 
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If the fitted line is a rectilinear one, R is merely r, the coeffi- 
cient of correlation. This follows directly from our showing 
on page 240 that the standard deviation of the points on the 
straight regression line equals ray. For, by definition, 


For other regression lines general formulas can easily be made; 
or the standard deviation of the points on the regression line 
can be computed directly by reason of knowledge of the frequency 
at each column and the ability to calculate the J^ value at each 
column from the equation of the fitted curve. 

We may apply this technique to testing the rectilinearity of 
regression for the data in Table XXVII, employing the values 
of the statistics found earlier in this chapter. 


_ .0544 - (-.163)2 
« 1 - r* 1 - (-.163)2 


.0286 


e'* has the same form of distribution as e*, so we use the same 
1/ablcs for interpreting it. The value cited on page 326 for this 
table for e* -when the true correlation is zero was .029 at the 
5 per cent point and .047 at the 1 per cent point. So the obtained 
value for lies only a little distance below the 5 per cent point 
and the departure from rectilinearity is shown to be barely 
significant. This tallies with the other tests made earlier in this 
chapter. 

When a parabola is fitted by the methods of Chap. XV, its 
equation turns out to be 

Y = 4.1812 + 1.1091X - .2288X2 


The B* is found, by computation, to be .253. Therefore 


e* - B* _ .0544 - .0652 
* ~ 1 - B* 1 - .0652 


-.0108 


This is a low value, much below the 5 per cent point, .027. So 
the parabola gives an excellent fit. The is negative, which 
means that the deviations are actually less than they would be 
on the average if the true regression line were the one which 
we fitted. i?2 can never be negative, but can be. If the true 
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relation is zero, the €^'s from samples must average zero, so that 
some samples must yield negative 

Es;ercises 

1. Compute 71 and « for Table XXVIII, and determine the probability 
that there is a true correlation above zero; the probability that the regression 
is rectilinear* 

2. Test the rectilinearity of regression in Table IX, page 100, by both the 
X® and the tests. 

3. Apply the correlation ratio technique to the exercises used in the next 
chapter and compare it with the analysis of variance technique. 

4. With a large population of suitable scores from a study to which you 
have access, try computing a partial tj and partial e. 

References for Further Study 

Ezekiel, Mordicai: ''The Determination of Curvilinear Regression Sur- 
faces in the Presence of Other Variables, /. Amer, Statistical Assoc,, 
Vol. 21, pp. 310-320. 

IssBELis, L.: "The Partial Correlation Ratio, Biometrika, Vol. 10, pp. 391- 
411. 

Kelley, T. L.: "An Unbiased Correlation Measure,” Proc, Nat Acad, Set, 
Vol. 21, pp. 564-659. 

Student: "Correction to Be Made to the Correlation Ratio for Grouping,” 
Biometrika, Vol. 9, pp. 316-320. 

Woo, T. L.: "Tests for Ascertaining the Significance of the Correlation 
Ratio,” Biometrika, VoL 21, pp. 1-66. 



CHAPTER XII 
ANALYSIS OP VARIANCE 
ANALYSIS OF THE SAMPLE VARIANCE 

At least to persons already familiar with rectilinear and curvi- 
linear correlation, we believe that the most illuminating approach 
to the now popular analysis of variance is through these familiar 
concepts. We shall show first that, so long as we stay within 
the sample, analysis of variance is an extremely simple process. 
After we have shown this, we shall broaden the concept and 
lead by successive steps into some of its more complicated 
ramifications. 

The reader is asked to refer again to a typical correlation chart, 
such as that on page 100. It will be observed that there remains 
some scatter in each y column even though all the individuals in 
the column have the same x value. In other words, when x is 
held constant, there still remains some variability in the y scores. 
But, when correlation is present, this variability is less than that 
for the whole distribution; put in terms of proportion it is 
Since this is the proportion of the variance (the remaining 
when X is held constant, it may be considered the proportion of 
the variance in y attributable to the factors in y other than z. 
Conversely, the reduction in variance when x is held constant is 
the part of the variance attributable to the x factor. Put in 
terms of the proportion of the entire variance of y, this is 



Now, as shown on page 117, 

r = - whence 1 

Thus the total variance may be divided into two portions of which 
the proportion attributable to the a factor (or rather, to what is 
common to x and p) is e(]u^ to r® and the proportion attributable 

33t 
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to the other factors is = 1 — r® is sometimes called the 
coefficient of determination; hence the proportion of tho total 
variance attributable to the factor that is correlated with y is 
the same as the coefficient of determination. 

But in the above formula cr® was taken from the straight regres- 
sion line as origin rather than from the means of the respective 
colunms. That is not what is customarily done in computing a 
tr. If the reader will now refer to the correlation ratio, page 312 
in our preceding chapter, he will find this limitation removed 
in the following formula for the correlation ratio; 



where is computed from the means of the columns as origin. 
This is true for only when the regression is strictly rectilinear. 
Hence it is always true (assuming homoscedasticity) that the 
proportion of the variance attributable to the x factor is 
and the proportion to the other factors is erj/orj, which is also 
1 — In formula (174), page 314, it is shown that 



Hence we may restate the above in the following form: The 
variance of y is separable into two parts; the proportion attribut- 
able to X is the proportion attributable to factors 

other than x is (r^/etj = 1 — ,j2. 

Since these relations are fundamental in the problem of analy- 
sis of variance, we shall make another (independent) approach 
and arrive at the same conclusion. But we shall adopt a more 
conventional notation; instead of using a subscript m to denote 
a mean, we shall place a bar over the letter representing tho array 
of which it is the mean. Thus, o-j means the same as o-m,. We set 
up the following identity, for a single score: 

{y - y) = iy - §c) + (§« - #) 

the barred y without a subscript referring to the mean of the 
whole y series while that with the subscript e stands for the mean 
of the column in which a particular y score is found. Squaring, 

(y - vY = {y- ycY + (^c - pY + 2(y - fc)i9o - p) 
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Now sum for all individuals, first by columns and then across 
columns for the entire table. Let k denote the number of columns 
and Uc the number of individuals in a column, the letters below 
and above the summation sign indicating the limits between 
which we sum. 

- y? = - ycY + - yY 

+ 2Sj2j»i(y - yc)iyc - §) 

As long as we sum within columns, (y« — yY will remain the same 
within the several columns. When we sum across the columns, 
we shall get 

- yY 

When we sum by colunpis in the cross-products term, (ye — §) 
will remain a constant; but for each column 2 ( 2 / — y^) will be 
zero, since the y’s are taken as deviations from the mean of the 
column ye as origin. Hence, in summing for the whole table, we 
have 

(A) 2f(2/ — yY = 2?2J*.(2/ — ycY + 2jnc,(yo - yY 

By reason of the meaning of a sample variance, this can be 
written 

N<4 = 2n„,(r2, -h 2no,4 

If, now, we assume homoscedasticity, we shall have 
N<4 = 2ne^e + 

But Sne/ = JV, since the sum of populations by columns gives 
the entire population. Whence 

Na§ = Ncrl + Ncrl 

Dividing by JV, 



Thus again we are brought to the fact that the sample variance 
may be analyzed into two portions, one of which is the variance 
within the columns (or classes) and the other of which is the 
variance of the means of classes. 

In this development we have carried the general case where 
the populations in the various classes may be different; hence 
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our ff^’s are weighted for the frequency of the several classes 
contributing to them. If we had chosen the special case of a 
symmetrical table, where all classes have the same frequency n, 
the derivation would have been much simpler. 

ANALYSIS OF THE POPULATION VARIANCE 

So long as we confine ourselves to analysis of the sample 
variance, analysis of variance is a very simple and straight- 
forward process; it is merely another way of expressing what can 
be put as 57® or as r®. But R. A. Fisher, who introduced the 
technique, chooses to project the analysis into the population 
variance (see page 69) rather than keep to the sample variance. 
There is available a precise test of reliability on that plane. We 
shall now turn to that form. 

We cannot carry the general case by the Fisher method; we 
must restrict the application in two respects: (1) We must 
(if we are to follow strictly the mathematical requirements) have 
always a symmetrical table — each class (column) containing 
the same n; and (2) we must limit the problem to the application 
of the null hypothesis, i.e., we must assume a homogeneous 
population (no correlation) and test to see whether that hypothe- 
sis is tenable. We reenter our development above at (j 4). But 
since the n is to be the same in each column, this will take the 
following simple form: 

2f(2/ - yy = S?S^(y - #.)® + n2l(y, - ijy 

where n is the number in a class (the number of rows) and k is 
the number of classes (of columns). We may estimate a popular 
tion variance from the first sum of squares by dividing by 
(N — 1), and from the second by dividing by (N — k), as shown 
on p^ge 321. From 2(§, — y)® we can estimate the variance 
of the means of the infinite supply of random samples which 
make up the population by dividing by (fc — 1). But remember 
that, if we are dealing with random samples, of the same size 
n,a^ = ff®/ n, where ff® is the true population variance. So, clear- 
ing of fractions, S'® ,= iioi. Hence the last term, n2(fo - gy, 
can be made to estimate the population variance by dividing by 
(fc — 1). Thus we have three estimates of the population vari- 
ance as follows, derived from the sums of squares and the degrees 
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of freedom standing below them: 

Si $l 

- y)^ Vc)^ n'Ziyc - yY 

N -I N -k k - 1 

But we may no longer carry the equality sign between the first 
and the sum of the two others, because they have been divided by 
different values. Each, now, estimates a population variance. 

The first one estimates the variance of the measures including 
all factors. The second estimates a variance for a hypothetical 
population in which the x factor is held constant but the other 
factors in y are allowed to vary. The third estimates a meaning- 
ful population variance if the assumption of no correlation is 
completely fulfilled. For 5"^ = only if the samples from 
which is taken are completely random ones, of the same size, 
and drawn according to the laws of chance upon a whole homo- 
geneous population. It is these two assumptions — ^homogeneous 
population and samples of equal size — ^that limit the analysis of 
variance technique to the null hypothesis and to tables with 
columns all of the same n. In practice, adjustment is made for 
unequal columns, but that is a rough adjustment without strict 
mathematical warrant. 

THE TEST OF SIGIHFICANCE 

Now even if the classes (the columns) in our table differed 
from one another and from the whole distribution only by chance, 
these three estimates of the population variance would differ 
somewhat merely by reason of fluctuation in sampling. But to 
the extent to which there is present some law which brings it 
about that the classes differ materially in mean score, to that 
extent the population variance estimated from the means of 
classes will be large in comparison with that estimated from 
within the classes themselves. When the difference is small, 
chance fluctuation can plausibly explain it; but when the differ- 
ence becomes great, it cannot be plausibly attributed to chance. 
The formula developed by Fisher for testing the divergence of 
these estimates of the population variance does not, however, 
involve subtracting the variances but rather dividing one by 
another. This is a more s^itive and precise way of measuring 
divergence than subtraction would be. 
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The test assumes the null hypothesis; if the classes were really 
all alike — “belonged to the same homogeneous population” — 
what would be the probability of getting in a sample so groat a 
divergence as the one we have in hand in our sample? The 
answer involves a derivation that is merely an extension of the 
ones for Student’s t and for Pearson’s x** We show something 
of it in Chap. XIV. If independent samples are drawn from an 
infinite homogeneous parent population, these samples will differ 
in variance. The chance of obtaining a given sample can be 
stated in terms of probability, and the probability of obtaining 
simultaneously any two or more samples is the product of the 
probabilities of obtaining them separately. By stating mathe- 
matically the probability of obtaining two variances simul- 
taneously and then integrating, it is possible to determine the 
probability of obtaining two variances which diverge from each 
other by a given amount even though both samples arise from the 
same parent population. The process is inherently simple and 
straightforward, but the necessity of successively integrating e 
functions involves some mathematical dodges and makes the 
arithmetic laborious. For this reason it is not feasible to deter- 
mine at each application the probability that two variances as 
divergent as the ones in hand might have arisen by chance from 
the same parent population. So Fisher has tabled these proba- 
bilities for certain values. They must be tabled in terms of the 
size of the two samples as well as the extent of divergence betwcion 
the estimated variaitees. Fisher tabled these in terms of a 

1 s* 

function he calls z, which is •= log, and also equals 

(log. Si - log, Sz) = i(log. S? - log, si). 

But Snedecor tabled Si/s|, which he designated F, because that 
is the fimction obtained directly from the calculations and thus 
saves looking up log values. Many people believe Sncdccor’s 
table is the most convenient in use.^ s? is always to be taken as 
the larger of the two variances. A fundamental condition of the 

^ We do not include in this volume tables of F or of t, because we believe 
that the research workers for whom we are writing should usually employ 
the e technique described in our preceding chapter. The « technique tells 
all that analysis of variance tells and more. We give tables for the dis- 
tribution of «*. Those who wish to use the F and a tables can find them in 
other books. 
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test, of significance is that the two estimates be independent. 
This makes it necessary to compare the variance estimated from 
the means with that estimated from the classes, since the other 
pairs of variances are correlated. Other comparisons can be 
made by adjusting for the element of correlation. 

EXAMPLES OF ANALYSIS OF VARIANCE 
We shall now give a simple example of analysis of variance. 
Table XXIX displays the number of pounds of milk given in a 
month by six cows of each of five breeds as taken from the records 
at Pennsylvania State College. The problem is to determine 


Table XXIX. — Number of Pounds of Milk Given by Six Cows op Each 
OF Five Breeds in 1 Month at Pennsylvania State College 


Cow No. 

Breeds 

Holstein 

Jersey 

Guernsey 

Ayrshire 

Brown 

Swiss 

1 

1,562 

914 

926 ' 

1,080 

1,237 

2 

1,897 

920 


1,231 

1,246 

3 

1,659 

1,147 

831 

1,347 


4 

1,594 

712 

989 

999 

1,112 

5 

1,536 

702 

819 

1,375 

1,013 

6 

2,498 

727 


1,009 


Totals 

10,645 

5,122 

6,169 

7,041 

6,761 




ZSy for whole table, 34,738 
SSy* for whole table, 44,702,480 

(6) (261,656,272) - 34738^ 
(5)(0) 


- Sc)® 




n 


6,658,608 

6 


- S)* 


- 2^ _ 30(44,702,480) - 34,7382 
N ^ 30 

, 2 _ n2(gc - g)® _ 3,368,424 


^ — 1 


6 


3,368,424 
1,109,768 

4,478,192 

842,106 


- 1,109,768 _ ,^300 

30-6 

„ . S(v - S)» ^ 4,478,192 __ ... 

V “ TyfZT ■= -go” 


(Note that SS(y — J,)* »• 2(j/ - §)\ This serves as 

a check on the arithmetio.) 
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whether chance fluctuation of sampling alone could explain the 
observed differences among the breeds while in reality all the 
breeds are alike in milk production (belong to the same Ixmio- 
geneous population) or whether this null hypothesis is untenable. 
If one has available a calculating machine, it is most convenient 
to obtain the needed sums of squares by the formulas given at 
the foot of the table, which are algebraic cquivalen(..s of tlK^ basic 
formulas. Making the calculations indicated, wo get the follow- 
ing as our three estimates of the population variance: 


From, means of columns, 842,106. 
From within columns, 44,390. 

From the total distribution, 154,420. 


Dividing the estimate from moans by that from within columns 
to get F, we have 


F 


si 842,106 
si 44,390 


= 18.99 


In order to see what the probability is of obtaining so gnsat 
an F merely by chance fluctuation, we enter Snedecor’s tabic 
with the ni for means equal to (k — 1), which is 4, and the na for 
classes equal to {N — k), which is 25. In the column for 
«! = 4 and the row for na = 25, we find 2.76 for the 6 per cent 
value and 4.18 for the 1 per cent. Our obtained F, 18.99, is 
much beyond even the 1 per cent value. This means that, if 
there were no true difference between the breeds in milk produc- 
tion, we would obtain so great a difference in variances much 
less than 1 time in 100. The difference in breeds is, therefore, 
highly significant and the null hypothesis, that the breeds might 
not differ, is refuted. 

We may show how this technique can be extended into educa- 
tional problems by the following examples. Dressel obtained the 


Source 

Degrees of 
freedom 

Sum of 
squares 

Moan 

square 

Between means of high schools 

14 

796 

19.51 
492.79 1 

1.393 

0.6197 

Within high schools . * 

Total 

S09 

612,30 

1 

0.6333 



^ 0.6197 


2.25 
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following data on the college grades of 810 students coming from 
15 different high schools. The problem was to ascertain whether 
different high schools differ significantly in the degree to which 
their graduates succeed in making good college grades. 

We do not find in Snedecor’s table an entry for 809 and 14 
degrees of freedom, but the F for 1,000 and 14 degrees of freedom 
is 1.70 for the 5 per cent point and 2.09 for the 1 per cent point 
while for 400 and 14 degrees of freedom the entry is 1.72 for 
5 per cent and 2.12 for 1 per cent. So our obtained 2.25 is 
beyond the one to be expected in even 1 per cent of the samples 
on the basis of chance fluctuation. So the differences of means 
of high schools cannot be reasonably attributed to chance; 
the high schools differ significantly in respect to the success 
of their graduates in college. If Snedecor's table of F is not 
available and the worker wishes to look up the significance 
from Fisher's z table, he must obtain 

z = i loge F 

which in this application is ^ loge 2.25 = 0.40546. If a table 
of natural logarithms is not available, z can be obtained from a 
table of common logarithms as follows: 

= ^(2.302685 logxo F) = 1.151294 logio F 

which the reader will find by verification to be for this application 
also 0.40546. Fisher's z table will then give interpretations 
entirely consistent with Snedecor's F table for the same number 
of degrees of freedom. 

So high schools are found to be significantly different in 
respect to the success of their students in college. But intrinsically 
the relation is low; the significance is high because the population 
is large. We can get a measure of the strength of the relation 
by computing as explained in our previous chapter. This is 
very easily done from the above data. It involves merely 
dividing the population variance estimated from ^'within high 
schools" by that estimated from the total, then subtracting 
the quotient from 1,00. 

^ ~ 0.6333 “ * ~ \402lii = .144 
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If we have computed e® instead of F, we can make the significance 
test by referring to our Table XLVII, page 497. Hero, for 
N — k = 1,000 and fc — 1 = 14, the at the 5 per cent point 
is .010 and that at 1 per cent is .015, while for iV — lb = 400 and 
fc — 1 = 14 the 5 per cent value is .024 and the 1 per cent .036. 
This tells precisely the same story regarding significance that 
the F test or the 2 test tolls; the e* could not reasonably be 
attributed to chance fluctuation of sampling. Because e® shows 
the strength of the relation as well as its significance and since 
the test of significance of gives outcomes identical with those 
for F or 2 , we publish only the table for and not those for F 
and 2 . 

As another example we shall use some data a part of which 
is from a study by Thorndike and a part hypothetical because the 
necessary details are lacking in Thorndike’s report. A test of 
mental ability was administered to 4,540 subjects who had taken 
different combinations of courses in high school, making nine 
different curricular groups. The problem was to determine 
whether the several curricula differed in the effectiveness of their 
training as measured by this test. 


Source 

Degrees 
of free- 
dom 

Sum of 
squares 

Mean 

square 

Between means of curricular groups 

Within curricular groups 

Total 

8 

4,631 

38,617 

14,644,610 

4,816 

3,210 

4,639 

14,683,027 

3,213 



F = 1.60 


For 8 and 1,000 degrees of freedom an F of 1.89 stands at the 
5 per cent level and 2.43 at the 1 per cent level, while for 8 
degrees and infinity the 5 per cent point is 1.88 and the 1 per 
cent is 2.41. So our F of 1.5 would arise by chance fluctuation 
more than 5 times in 100. There is, therefore, little promise 
in the hypothesis that the several curricula differ in training 
value. Nine curricula of these types which do not differ in 
training value in the infinite population could reasonably often 
give as large differences in a sample of our size as the ones we 
have in hand. 
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The reader may wish to try the e test on this problem as an 
exercise, 

ANALYSIS OF VARIANCE INTO MORE THAN TWO PARTS 

We may set up the following identity, for one individuars 
score: 


(y - y) = (5c - 5) + (5r - y) + (y - Vc - Vr + y) 

The yc stands for the mean of a column and the yr for the mean of 
a row. The identity involves merely adding certain values to the 
quantity at the right and then subtracting them, so as to balance 
the equation. If, now, we square and sum for all individuals in 
the sample, we shall get the sum of the squares of the four quanti- 
ties in the several parentheses plus a series of cross products. 
But the cross products all vanish, because the total of the sums 
from them is zero. We are thus left with the following expression 
(into which we have inserted an extra parenthesis for later 
reference). 

(5) Sf( 2 / ~ yy - ~ gy + - gy 

+ - yc) - (yr - y)]^ 

The first two terms at the right of the equality sign are the 
sums of squares ^'between classes,'^ like the ones we met above; 
only, we have both the sums of squares of means of columns and 
those of means of rows. The term in brackets is a residual 
remaining in the total variance beyond the two sums of squares 
from means of columns and of rows. We have already shown 
that population variances can be estimated from 2)2)(^c — y)^ 
and — 5)^ by dividing by the appropriate number of 

degrees of freedom, viz,, one less than the number of columns 
and one less than the number of rows, respectively. It can 
also be shown that a further estimate of the population variance 
can be made by dividing the residual by the appropriate number 
of degrees of freedom, which Irwin^ proves to be in this case 
(k — l)(n — 1). Thus we have 

Between columns, 2)2;(S<, — {h — 1) degrees of freedom. 

Between rows, — J)*, (n — 1) degrees of freedom.* 

Residual, 5/S(y — o — (k — l)(n — 1) degrees of freedom, 

* Irwin, J, 0„ ** Mathematical Theorems Involving Analysis of Vari- 

ance,'^ Boy'. Statistical Soc,, Vol. 94, p. 290. 
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When grouped in one way, as shown in (5), the entries in 
the brackets give, as close examination will show, the within- 
the-class sum of squares when the deviations are themselves 
taken as deviations from the means of the rows; and, when 
grouped in another way, the sum of squares within the other 
class as deviations from the means of columns. By taking the 
deviations in the columns, thus, from the means of the rows, 
the effect of the gross differences in rows is removed, and we have 
the residual variance in columns with the row factor held con- 
stant. If the population variance estimated from the residual 
is then compared with the population variance estimated from 
the means of columns, by the methods previously discussed in 
this chapter, evidence can be obtained regarding the departure 
of the column variation from chance with the row factor held 
constant. If the columns are independent of one another, as in 
our example where the Jerseys and the others were selected 
entirely at random regarding the Holsteins, the outcomes from 
this method will contain no new information; the significance 
will be the same except for random variation. If the entries 
in the columns (families) are matched in some manner, as by 
putting on the same row cows equally far along in gestation, the 
significance may be affected considerably. If, even with match- 
ing, there is no intercorrelation except zero among the columns, 
the significance will be unchanged. But, if there is positive 
intercorrelation, the residual will be decreased and the signifi- 
cance of the differences between families thereby increased. If 
there is negative intercorrelation, the matched group arrange- 
ment will yield a larger residual variance and a lower reliability 
than the random one. 

We shall illustrate this in the table below. The table was 
adapted from data given by Snedecor on the influence of certain 


Table XXX, — ^Yibld or Potatoes under Different Fertilizers 



1 

2 

3 

4 

5 

Total 

1 

C344 

£428 

4423 

£7317 

D323 

1,836 

2 

D367 

4430 

.£^398 

0387 

B4A7 

2,029 

3 

£817 

C389 

D426 

A389 

£7449 

1,969 

4 

£303 

D393 

C404 

R347 

A234 

1,681 

5 

ii291 

£423 

J5412 

x>m 

0386 

1,944 

Total 

1,622 

2,063 

2,062 

1,872 

1,839 

9,46S 
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fertilizers on the yield of potatoes. The table contains several 
features of which we wish to make use later and which we ignore 
here. One of these features is the prefacing of each entry by a 
letter; ignore that for the present. Nor is it necessary for 
our present purpose that the arrangement have the same number 
of rows as columns. It could, for our present purpose, be a 
five by six, or any other rectangular arrangement. Our only 
present requirement is that the items in a row belong together 
as a class — as the same side of a field, pigs of the same age, or 
teachers employed in the same city. 

The outlay in Table XXX represents a field divided into 
five strips (rows) and subdivided into 25 blocks by strips in the 
perpendicular direction. Let us say that the rows represent 
north-south divisions of the field into strips which may differ 
in fertility, and the columns represent the east-west orientation. 
The numerical entries represent the average number of bushels 
per acre in the blocks. Our first concern is to find whether 
the field is homogeneous in productiveness. Test first for east- 
west homogeneity, then for north-south homogeneity. This is 
done just as in our previous example. We have the following: 


Source | 

Sum of squares 

Degrees of freedom 

Mean 

Total 

73,667 

26,860 

46,807 

i 

i 

(N - 1) « 24 
()c - 1) = 4 
(N - A:) * 20 

3,069 

6,712 

2,340 

Between columns 

Residual 



F « ~ 2,87. P =* 6 per cent 


For north-south (rows) as follows: 


Source 

Sums of squares 

Degrees of freedom 

Mean 

Total. 

73,667 

16,034 

68,623 

24 

3,069 

3,768 

2,931 

Between rows. 

4 

Residual. 

20 



o 

F ^ 1^28. P > 5 per cent (P is greater than 5 per cent) 


By this test the field appears to differ somewhat in productivity 
as we go from east to west; the F for columns is exactly at the 
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5 per cent level, meaning that, if in the true population they did 
not differ, we would have obtained so great a divergence between 
our estimates of variance only 5 times in 100. But in the north- 
south direction heterogeneity is not established, since the F 
stands much below even the 5 per cent level and means that wo 
would get so large a discrepancy considerably more than 5 times 
in 100 merely by chance fluctuation. 

But now we shall apply the technique discussed in the para- 
graph preceding the table; we shall hold rows constant in pro- 
ductivity and test the columns for homogeneity. Then wo shall 
hold columns constant and test the rows for homogeneity. 

In the above procedure the sum of squares in our residual was 
the total sum minus that for between columns^' while we were 
testing columns, and this same total minus that “between rows'^ 
when we were testing rows. But here the residual sum of squares 
will be, as inspection of Eq. (J5) shows, the total loss the sum of 
the squares between means of columns and that between means 
of rows. That is, the residual is 

73,657 - (26,850 + 15,034) = 31,7/3. 

This residual is the same for testing both rows and columns 
and is always most easily obtained by subtraction from the 
total. The degrees of freedom for this residual arc now only 
(k — l)(n — 1) — (4) (4) = 16, so that the mean is 1,986. So 
we have for columns 


F = ^ 
1,986 


3.38. 


1 < P < 5 per cent 


(P is greater (Iian 1 
and less than 5 
per cent) 


For rows, 

F = = 1.89. P > 5 per cent 


Evidence of lack of homogeneity in the patches is increased 
by this added element of control, in respect both to rows and 
to columns. In the case of the columns it reaches a point 
which gives fairly conclusive evidence that the strips differ in 
productivity. 


THE LATIN SQUARE 

We now introduce a third element of control, for which 
the letters preceding the yields entered in Table XXX were 
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employed. The letters stand for different fertilizer treatments. 
Each of five fertilizers, represented by the letters A, 5, (7, D, E, 
respectively, was used in five blocks scattered through the field. 
The particular layout of the field now becomes important to us. 
We observe that each replication of a fertilizer treatment occurs 
in a different row and a different column, one replication in 
each row and one in each column. This necessitates that the 
layout be square, a fc by fc table with k experiments each repli- 
cated k times. This arrangement is called the Latin square. 

We want now to test whether or not the fertilizers designated 
A, B, C, D, Ej respectively, affected the yield of potatoes differ- 
ently when the productivity of the 25 blocks is equated in respect 
to both rows and columns. We want to get a residual sum of 
squares as the ^^experimental error" that will be freed from the 
systematic contribution of differences in fertilizers. That sug- 
gests that we equate these scores by subtracting (algebraically) 
from each fertilizer score the difference between the mean of the 
class to which it belongs and the grand mean. This is another 
way of describing a process exactly similar to the one to which we 
resorted on page 341 when we were providing for the analysis of 
variance into three parts. Hence in the residual we subtract 
from the expression on page 341 such a differential and, to 
balance the equation, also add it. Calling the mean of a fertilizer 
class y/j we have 

{y -y) = i§c -y) + (Vr -y) + {y/ -y) + {(y - y.) 

- [(yr -V) + ipf - y)]} 

If, now, we square and sum, all cross products will sum to zero 
if the fertilizer treaiments are so arranged that one replication 
occurs in each column and one in each row, as happens in the 
Latin square. In other random arrangements they may approxi- 
mately sum to zero but there is no mathematical assurance that 
they will do so. Thus wc have left 

2(y - gy = S(^. - py + sCyr - py + S(y/ - py 

+ 2(y - pc- pr + y -y/ + py 

To the two sets of sums of squares between classes we add a 
further one, that of the means of fertilizer classes. The residual 
now is reduced and is best obtained by subtraction from the 
total. If the conditions named above have been fulfilled^ a 
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population variance can be estimated from the new residual by 
dividing the sum of squares by the appropriate number of degrees 
of freedom. The number of degrees of freedom is fc — 1 loss than 
before, where h is the number of replications of the experimental 
factor.^ In this case the degrees of freedom are 16 — 4 = 12. 
Summing by classes the scattered scores for fertilizer treatments 
we get the following: 



Sum 

Mean 

A 

1,767 

353.4 

B 

1,951 

390.2 

C 

1,910 

382.0 

D 

1,940 

388.0 

B 

1,890 

378.0 


The sums of squares between rows and between columns we 
had before. We can easily calculate the sum of squares of the 
means of the fertilizer groups from the data given just above. 
We get the new residual sum of squares by subtraction from the 
total. Bringing all these together we have the following: 


Source 

Sum of 
squares 

Degrees of 
freedom 

Moan 

Total * 

73,657 

26,850 

15,034 

4,347 

27,426 
^ 1 

24 

3,069 

6,712 

3,768 

1,087 

2,286 

Between columns 

4 

Between rows 

4 

Between fertilizer classes 

4 

Residual 

12 



In order to test for reliability, we now divide each population 
variance estimated from between classes (i.e., from means of 
classes) by the one estimated from the residual and have the 
following: 

For columns 

F = = 2.94. P > 5 per cent 

For rows 

F = = 1.64. P > 5 per cent 

1 Fishbb, R. a,, Statistical Methods for Research WorkerSf 7th ed., p. 27d. 






ANALYSIS OF VARIANCE 347 

For interpreting F, the table must be entered with 4 and 12 
degrees of freedom. 

For fertilizers the mean from between classes is actually 
less than that from within the classes. This indicates that the 
fluctuation from class to class is less than that which would 
ordinarily come from chance sampling. So the fertilizers evi- 
dently have no differential effect that this experiment determines 
— ^unless it should exert some influence to make the average of 
the classes alike without simultaneously making the individuals 
within classes alike, which is extremely improbable. It is, 
therefore, highly improbable that there is a real effect rather than 
a chance one. But we shall look up its probability anyway in 
the F table. We must always divide the larger by the smaller 
variance, since the distribution would be of the same shape for 
negative deviations as for positive. 

O OQK 

F = j^Qgy = 2.10. P > 5 per cent 

For 12 and 4 degrees of freedom an F of 5.91 stands at the 5 per 
cent point. So an F of 2.10 could easily come about by chance. 

It is possible to arrange a Latin square so as to admit still a 
further factor. Then each cell will contain a score according to 
one classification designated by a Latin letter and the same score 
according to another classification represented by a Greek letter, 
so that each cell entry will be prefaced by two letters. This is 
called the Greco-Latin square. The arrangement must be such 
that each Latin letter appears once in each row and in each 
column, each Greek letter once in each row and each column, and 
each Latin letter once with each Greek letter. This permits the 
analysis of variance into four parts besides the residual (error). 
The mathematical derivation of its formula would follow along 
the same lines as the one w'e gave for the Latin square. The 
number of Greco-Latin squares that can be set up is narrowly 
limited; out of all the possible Latin squares only a small fraction 
can be arranged as Greco-Latin squares. The interested reader 
may pursue this further in Fisher’s Design of ExpesriTneriis, 
pages 90 to 93. 

The analysis of variance into three parts (between rows, 
between columns, and residual) is not limited to the Latin square, 
though it is limited to a rectangular table in which rows consist 
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of scores matched on one basis and columns consist of scores 
matched on another basis. The analysis into further factors 
(without subclasses) is limited to the Latin square or to some 
other equally effective method of randomizing the plots. It is 
clear that such an experimental design as the Latin square fits 
agricultural research especially well. A field is likely to differ in 
fertility even in closely proximate positions. The division of the 
field into blocks so placed as to sample all parts of the field in a 
systematic way is an excellent scheme for making probable 
equally favorable conditions for all the experimental factors. 
Sometimes it may be useful in other types of research (see Exor- 
cise 4, page 369). But research workers in education, psy- 
chology, and sociology, for whom chiefly we are writing, are 
likely to find fulfillment of its peculiar replication requirements 
cumbersome and impractical. We shall later have something 
to say about borrowing research techniques which were designed 
for one type of problem and trying to fit them into another. 

ANALYSIS WITH SUBCLASSES 

Further complexity is introduced into analysis of variance 
when each class is divided into subclasses and certain comparisons 
are made involving the subclasses. This is really only an 
aggregation of elemental problems which, taken singly, are 
precisely the same as the ones we discussed above. It is a 
case of “wheels within wheels.” We think it best, at least for 
novices and probably for all workers, to attack these phases one 
by one instead of driving them all abreast.^ Always one should 
realize that his problem consists in facing an aggregate of classes 
which may differ more or less in respect to the position of their 
means, and his question is whether these means differ more than 
the variability within the classes would justify on the basis of 
chance. Sometimes there will be a set of subclasses viewed 
within a larger class which itself is only a part of the whole; 
sometimes there will be a number of such sets of subclasses 
averaged together. But always the investigator should approach 
his problem by putting a certain question to it — a certain 
hypothesis — and manipulating his data in such manner as to 
give him the answer to that particular question. Each question 

^ A good example of such step by step analysis will be found in L. H. 0. 
Tippett, The Methods of Statistics, Willems and Norgate, 2d ed,, 1937, pp, 
218-226. 
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will demand bringing together certain classes and comparing 
them in certain ways. If he keeps his eye clearly on the means 
ho is examining for fluctuation and the classes of which they 
are the means, he will have no difficulty with such issues as 
what sums of squares are required or what are the numbers of 
degrees of freedom. 


DEGREES OF FREEDOM 

In order to remove some of the sense of magic which, for the 
layman, centers about this concept of degrees of freedom appro- 
priate for estimating a population variance, we shall show Fisher’s 
derivation for the case involving the estimate from ^'within 
classes.”^ It can be shown that the distribution of estimates 
of variance from samples is such that the probability that an 
estimate will fall in the range dSp is 

Tlp~3 TlpBp^ 

where is the population of the array in the sample and Cp is a 
quantity depending only on Tip. Since the columns of a correla- 
tion table (or the classes in any analysis of variance setup) 
are assumed to be independent, the probability that all the 
observed values of will fall in assigned ranges is the product of 
all such probabilities for all the k columns or classes. The 
optimum estimate of a is the value of <r which will make the joint 
probability a maximum. In order to find this value, we differ- 
entiate the function with respect to cr, equate the derivative to 
zero, and solve for c (see pages 10 to 15 if necessary). We shall 
do that with the expression here made up of the products from 
the columns. But first we shall take logs, then differentiate. 
Remember that the log of a product is a sum of logs. Let P be 
the joint probability. Then 

log P = 2)(log Cp) - [S(np - 1)] log 0 - 

■f S(np - 3) log Sp — ■^(Snp4)<r~* + 2 log d(«®) 

The reason no log appears in the next to the last term is, of 
course, because it would be log. e, which equals 1. Taking 

1 PxsHisR, R. A., “Tbe Gk>odness of Fit of Regresmon Formulae,” J. Roy, 
Suaistiooil Soe., Vol. 86, pp. 699-600 (1922), 
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derivatives with respect to <r (see page 22 if necessary), we have 

= -[S(n, - 1)] i + [S^.4] 3 

CT (T V 

Equating this derivative to zero and solving, we got 

[2(np - 1)W = 2npS* 

so that the value of which will make P a maximum, which 
we shall designate is 


A2 - 

S(np - 1) 

But S(np — 1) = 2np — 'Ll = N — k and s® = Liy — ypY/uj,; 
whence 

AS - - y^y 

“ N-k 

where the double summation is over all the cells in all the columns. 

Since k is the number of classes (columns), it is clear that 
the number of degrees of freedom when estimating the population 
variance from within classes will be the total N of tlie sample 
utihzed less the number of classes. If the classes themselves 
all have the same n', then {N — k) = Qon' ~ k) — k{n' — 1). 
That the number of degrees of freedom for the total is (iV — 1) 
was shown very simply on page 70. In the case of means 
(between classes) the divisor is {k — 1), wliich involves again 
the same principle as the {N — 1) for which we have just cited 
the reason. Irwin has shown that the case of analysis of variance 
into more than two parts reduces algebraically to the same basis. 
Determination of the number of degrees of freedom in regression 
and in other applications follows equally logically with the proper 
adaptation for the type of distribution involved. The reader 
has, of course, noticed that the degrees of freedom are additive, 
which fact follows from some complication of the algebraic 
expression {N — k) + (k ~ 1) — {N — 1). We have also shown 
that, because the cross products vanish, the sums of squares 
are additive and each sum of squares corresponds to the appro- 
priate degrees of freedom. But we believe that workers wiU 
perform their analyses much more safely and intelligently if, 
instead of depending upon this mechanical principle, they 
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will, as said above, get their eye on the classes they are comparing 
— ^with the variation of the means of these classes and the varia- 
bility within the classes — and picture to themselves what 
they are doing, in the more fundamental sense discussed in this 
paragraph. 


FURTHER RAMIFICATIONS OF ANALYSIS OF VARIANCE 

The conventional treatment of analysis of variance includes, 
besides a much fuller account of analysis with subclasses, schemes 
for adjxistiiig for classes of unequal populations, for interpolating 
scores, for correcting for covariance, for confounding replica- 
tions, etc. It is beyond the scope and purpose of this book 
to pursue these topics. The interested reader can find them 
treated in such books as Snedecor's Statistical Method, Tippett^s 
The Methods of Statistics, Rider’s Introduction to Modem Statis- 
tical Methods, Fisher’s Statistical Methods for Research Workers, 
aiad Fisher’s Design of Experiments. 


THE SPECIAL CASE OF TWO CLASSES 

Analysis of variance may be applied, with interesting results, 
to the special case of two arrays. This, the reader will observe, 
involves .the question whether the means of the two classes differ 
significantly and is, therefore, the familiar ease of the significance 
of the difference between two means, assuming the null hypothesis 
which we treated on pages 177-179. This, according to the 
technique explained there, is expressed by the relation 


' ' VdM) + (IM) 

where s is the population variance estimated from the two arrays 
jointly. In terms of analysis of variance we have 


(D) Between classes, Niixi — xy + N%{x% — xY with {h — 1) 

‘ = (2 — 1) — 1 degree of freedom 

(jEO Within classes, ^ XiY + S(xz — ^ 2 )^ with (Ni + ^^2 

^ 2) degrees of freedom 

Now the mean, is 


NiXx + ^^ 2^3 
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Substituting this in (D) and simplifying, 


y* “ A>. + y. ) + V’ ~ N, + w j 

fNiXi + NiXi — NiXi — 

nt+ni ; 

, ,r /NlXi + NsX 2 — Ni 


(Nx + N^)NxN,(xx 
(Nx + N,y 


2 + NIN 2 


(xi — XiY 


, xr + N 2 X 2 — NxXx — ATaSCa^ 

+^’V w+Ni ; 

= ATiiVI ~ _l_ (x 2 — Xi)^ 

' * {Nx + N^Y ^ {Nx + NiY 

_ {Nx + N,)NxN,{xx - xxxY _ NxN 2 .. X, 

{Nx + N,Y ~{Nx + N,)^^^ 

(F-\ - (^1 - X 2 Y 

^ ^ ~ {1/Nx) + (l/iVa) 

Now Eq. (F) divided by its number of degrees of freedom 
(which is 1) gives 8* as estimated from between classes, and Eq. 
(E) divided by its number of degrees of freedom (which is 
Ni + Nz — 2) gives s* as estimated from within classes. Whence 

p (^1 ^2)^ 


(f, + w) 


The 8^ is calculated in the same manner as shown on page 
178. So comparison of {€) and ((?) will show that F is precisely 
We can test the significance either by looking in the P or 
2 tables for testing the relation of estimates of variance or by 
looking in the t table for means. We must enter the F table 
or the z table with ni = 1 and = N — 2. If the iV’s are even 
reasonably large, we may use the normal-curve tables for t. 
Otherwise we enter the special table for Student's distribution 
with n = {Nx + Ni- 2). 

Thus analysis of variance can be employed to test the signifi- 
cance of the difference between two means; it will give exactly 
the same result as the conventional difference of means technique 
when the null hypothesis is assumed — ^as, indeed, it must if both 
methods are correct and mathematics continues to be consistent. 

There has begun to be some use of this technique in educational 
research.^ But we can see no advantage whatever in it. The 


* See Bond, Eva, “Reading and Ninth Grade Achievement,” Teaoh, CoU. 
ComHb. Eduo. No. 766, 1938.' 
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analysis of variance technique gives no added information 
whatever over the difference of means technique; its arithmetic 
outcomes are precisely the same. On the other hand, it 
suffers from the fact that the tables of z and of f are much less 
complete for this case than are the tables for i. It suffers 
particularly from the fact that its relations are less clear to 
the layman, hence making its appeal as magic. Of course, 
it is by its nature limited to confirming or refuting the null 
hypothesis and cannot work into the more general case repre- 
sented by formulas (90) and (95), to say nothing of all the other 
more positive techniques of classical statistics. The fact that 
analysis of variance technique can be extended to cover the 
case of two classes is of academic interest in showing that the 
analysis of variance technique is general. But the fact that it 
can be used in this apphcation is no reason why it should be 
used when more effective alternative techniques are available. 

THE RELATION OF ANALYSIS OF VARIANCE TO € 

In our preceding chapter we explained and extended a statistic 
recently developed by Kelley — ^the unbiased correlation ratio 
which he named e. Epsilon involves much the same calculations 
as analysis of variance. The F and the z tests employed with 
analysis of variance do not directly indicate the strength of the 
relation that is present, but only its reliability. Analysis of 
variance, that is, tells only the negative side of the story, limiting 
itself to confirming or refuting the null hypothesis. Epsilon, 
on the other hand, shows in language with a uniform meaning 
what is the strength of the relation that is present and at the 
same time permits an “exact" test of its reliability. There is a 
functional relation between e and F, as follows:^ 

p _ (iv - ky + (fc - 1) 

^ “ (fc - 1)(1 - €*) 

where k is the number of classes and N is the whole population 
of the sample. Whereas 6 is the same for a given strength of 
relation regardless of the size of the sample or the number of 
classes into which it is divided, F varies with the size of the sample 
and the number of classes for a given strength of relation, as • 
inspection of the above formula shows. Epsilon has a meaning 

‘ See pp, 421-422. 
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as uniform as that of r, with which, in fact, it becomes identical 
if the regression of classes along an ordered axis is rectilinear. 

The relation of e to analysis of variance is mosl, obvious 
when the analysis of variance is into two parts — between classes 
and within classes, which is the usual form. But it obtains in 
the same manner when variance is analyzed into more than 
two parts, as discussed on pages 341 to 344. For this further 
analysis merely adjusts the scores so as to free the variation in 
the residual from additional controlling factors, whereupon the 
residual scatter normally becomes less. By definition of the 
squared correlation ratio it is merely 1 minus the residual 
variance from the means of classes divided by the total variance; 
and e can just as properly turn on a corrected residual variance 
as F can. 

But in this application we cannot compute e in terms of the 
wi thin-class variance over the total variance; we niust, instead, 
compute it in terms of between classes (i.c., means of classes) 
and within classes (i.c., the residual). But in the case of columns 
of equal n's (which must always obtain where vaiiance is to be 
analyzed into more than two parts), this is sufficiently easily 
done. Straightforward algebraic manipulation of the funda- 
mental equations gives us for this case 

• Nai-(k- l)sg 

* - Nal+ idf)st 

where (df) is the number of degrees of freedom appropriate to 
the residual. The here is the variance of the means of classes 
in the sample and is very different from the population variance 
estimated from the means. But s® is the population estimate 
from the squares within classes, obtained by dividing the sum of 
squares by the degrees of freedom in the customary manner. 
We can, however, put both of these variances in terms of popula- 
tions estimates if we wish. Letting sj, be the population variance 
estimated from the means in the customary manner [i.e., by 
dividing n2(So — vYhy k — 1], we have 


= (fe - 1)4 - (fc - l)sg 
(k - l)s*, + (d/)sf 


( 186 ) 


Itedoing by the epsilon technique the problem of the relation 
of columns to productivity in potatoes with rows and variety 
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held constant (pages 345 to 348), we have 

^ 4(6,712) - 4(2,285) ^ 

4(6,712) + 12(2,285) 

In our table an of .361 stands at the 5 per cent point for 4 
and 12 degrees of freedom, so that the chances of obtaining an 
of .326 in this sample merely by chance are somewhat greater 
than 5 in 100, which agrees with the determination by the F 
technique. 

An illuminating outcome will follow by treating by the epsilon 
technique the case of varieties in that same problem. 


6 


2 


4(1,087) - 4(2,285) 
4(6,712) + 12(2,285) 


The is negative. While no negative 77^ can result from a sample, 
negative can arise by chance fluctuation from a true correla- 
tion of zero, or near zero. They arise only by chance, so that 
there is no use in looking up the reliability. The distribution of 

is not symmetrical and our table does not give negative 
But the negative values parallel roughly the positive ones. The 
,088 is far below the .361 which stands at the 5 per cent point for 
4 and 12 degrees of freedom. Our finding by this technique 
agrees, therefore, with what we obtained by the F test in analysis 
of variance. The will be negative whenever the population 
variance estimated from means of classes is less than that esti- 
mated from the residual. 

Partial epsilon, discussed on page 326, parallels analysis of 
variance with subclasses. 

Prior to Kelley's derivation of epsilon and our table of its 
distribution, the correlation ratio was of rather limited service. 
For the interpretation of eta was somewhat dependent upon the 
size of the population and the number of classes into which it 
was divided. Furthermore, there was available no '‘exact" test 
of the significance of ??. But e is entirely free from these limita- 
tions. It has a completely uniform and standardized meaning, 
and our table for its distribution is exact, ^ In fact the e test 


^ The term exact distrihuiion is a technical ^nn introduced into statistics 
by Fisher to mean that, in dividing the deviation of a statistic from a hypo- 
thetical value to get cognizance is taken of the fact that the divisor is not 
the true population variability but an estimate of it. For small samples 
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of reliability gives ’precisely the same results as the F test of 
analysis of variance for a given problem. The fact that « has 
a uniform positive meaning in addition to its ability to make an 
exact test of the null hypothesis should give it a useful place in 
statistics. 

It is true that, traditionally, and < have usually been thought 
of as belonging to those situations in which the classes could be 
quantitatively ordered on the x axis, though this has not been 
uniformly the case. But it is to be noted that there is nothing 
in either the t] or the e formula that depends upon the x placement ; 
the correlation ratio is wholly independent of such serial ordering. 
It is only if we wished to follow up the calculation of the correla.- 
tion ratio by curve fitting that we would be interested in the 
serial ordering of the classes. Such added purpose is wholly 
independent of the e itself. Moreover, analysis of variance, also, 
would be wholly meaningless if the classes did not belong to a 
common quantitative series which could, hypothetically, be 
quantitatively ordered. When, that is, one analyzes the variance 
of a number of breeds of cattle with reference to milk production, 
it is on the assumption that there is some x factor of which the 
different breeds have different amounts by reason of which the 
mean amount of milk produced differs from breed to breed. 
Apart from such x factor there could be no basis for comparison 
at all, any more than there could be a basis for comparing hoes 
with ideals. If it is true that analysis of variance must presup- 
pose the hypothetical possibility of quantitatively ordering its 
classes but need not stress the actual ordering and that « likewise 
permits such ordering but is not dependent upon it, there is no 
fundamental difference between the « technique and the analysis 
of variance technique in the types of situations to which they 
apply. 

After the e technique has shown the presence of some law and 
the extent of its strength, the next step is to study the nature 

this estimate is likely to be poor and the resulting distribution is more lopto- 
kurtic than the normal one. As the sample increases in size the estimate 
improves, so that s approaches 9 and the exact distribution approaches the 
normal. While theoretically differing anywhere short of infinity, the differ- 
ences between the two distributions become negligible when N reaches a 
moderately good size. 
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of that law. This will probably take the form of trjnmg to fit 
to the data several types of curves (see Chap. XV) and testing 
the goodness of their fit by e". Or it may take the form of 
comparing means and other statistics (such as variability, 
skewness, etc.) between the classes taken in pairs and of testing 
the significance of the differences by such techniques as are 
described in Chap. VI. 

THE PLACE OF ANALYSIS OF VARIANCE IN RESEARCH 

Analysis of variance belongs as a first step in a major research 
where one wishes to make a rough preliminary test of his hypothe- 
sis in advance of going to the expense of the elaborate setup 
needed for a thorough investigation. An agricultural research 
worker, for example, has the hypothesis that different varieties 
of wheat may, in a given locality, yield sufficiently different 
amounts of crops to justify adopting one of them rather than 
others. His first step may be to make a comparison of all of 
them simultaneously, with rather small samples, randomized 
in some effective manner as in a Latin square.^ If he finds that, 
in this trial, the varieties differ no more than chance would 
explain, he abandons his hypothesis; or at least he gives it a 
second preliminary trial. But, if his hypothesis is confirmed 
and he finds that the varieties do differ significantly on the 
average (for analysis of variance always lumps its classes into 
an average), he is ready to proceed with the positive aspect of 
his research. He will then set up his experiment, or series of 
experiments, with a single variable and a large sample, will 
undertake to determine which variety yields more than which and 
by how much of a differential, etc. Or an investigator in Educa- 
tion gets the hunch that teacher personality may influence the 
degree of introversion-extroversion of pupils. His first step may 
be to draw small samples of pupils from a half dozen teachers in a 
half dozen different cities, administer to them a test of intro- 
version-extroversion, and by the analysis of variance technique 

‘ Of course, when he actually sets up his preliminary study, he formally 
puts the hypothesis the other way around: he tries the null hypothesis that 
there may he no difference. But a research worker is ordinarily led into a 
problem by a positively conceived hypothesis rather than a negatively 
conceived one. 
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see whether there is any plausibility in his hunch. If there is, he 
will then proceed to the positive type of investigation, measuring 
the amount of differences and making tests of the probable limits 
of these amounts, correlating extroversion effects with certain 
measurable characteristics of teachers, etc. In this preliminary 
exploratory stage analysis of variance, vuth its limitation to 
refuting or confirming the null hypothesis, it s adaptation to small 
samples, and its ability to test simultaneously a number of 
variations in the experimental factor, may servo the purpose 
very well. It is especially useful in agiicultural resean^h, where 
the expense of secxiring large samples under experimental con- 
ditions is very great. But for the positive side of the re.scarch 
the investigator will need the standard procedures of classical 
statistics, such as correlation, curve fitting, and coutnist of 
correlated matched groups. Constructive research is just I'oady 
to begin where analysis of variance leaves off. In the field of 
educational research we are now finding some investigators who 
make a showing of their findings in terms of analysis of variance 
when the size and character of their sample woxild permit them 
to make the positive rather than the merely negative presenta- 
tion. Sometimes we find them, after making the positive show- 
ing, also making a showing in terms of analysis of variance. That 
is precisely parallel to the behavior of an engineer who would 
first successfully construct his bridge and thereafter conduct an 
elaborate argument to prove that it would \rdb<My ie possible 
to construct such a bridge. It is always pedantic to try to make 
forced use of statistical devices borrowed from another field 
when they only poorly fit. Statistical procedures are tools to bo 
drawn upon only as needed for definite and well-understood 
purposes, and those tools are best which are not only most 
natural for the worker but also most readily understood by the 
reader to whom the findings of the research are to be addressed. 
The great historical contributions to statistics did not come about 
by the intention of the author to make a statistical formula; on 
the contrary, they were inventions devised for interpreting cer- 
tain baffling research problems with which the investigator was 
confronted in some concrete setting. It is such natural emerg- 
ence of procedures from the needs of the situation, rather than 
the imitative use of statistics, that should be the ideal toward 
which we work. 
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WHEN A HYPOTHESIS IS REFUTED 

Since analysis of variance has for its purpose the dismissal 
of hypotheses that fail to meet the test of statistical signihcance, 
it is fitting to say a word about when a hypothesis has been 
refuted. There is danger that research workers may interpret 
too literally and mechanically the preliminary evidence afforded 
by the technique as to when a hypothesis should be abandoned. 
If the F falls below the 5 per cent point, this means that there 
are more than 5 chances in 100 that accidents of fluctuation 
might account for one’s finding and that he must not be at all 
sure of any real differences among his classes. But, conversely, 
it means that there are, maybe, 85 or 90 chances in 100 (8 or 
10 to 1) that there are real differepces which a better controlled 
study would reveal; and he might be quite unjustified in hastily 
giving up his hypothesis without further investigation. It is an 
error of one form to overreadily accept the conclusiveness of our 
findings; but it is an error of a second form to suppose that a 
hypothesis has been fully refuted when it has merely been brought 
below the level of certainty. 


Exercises 

1. H. L. Smith and M. T. Eaton give the data on the effect oi drill in 
fundamental combinations upon ability to add eight digit exercises as shown 
in the table on page 360. No drill preceded test 1. Successive tests followed 
at intervals of one week with drill on the number combinations interven- 
ing. Thus the drill was cumulative throughout the period within which 
the drill was given. 

Does the analysis of variance show significant differences in means among 
the four tests: (a) when variance is analyzed into two parts? (6) When 
variance is analyzed into three parts, taking cognizance of the fact that the 
columns are positively intercorrclated? Speculate upon the meaning of the 
different outcomes you get by these two different procedures. 

% Compute and interpret e for this table. 

3. Would r be an appropriate statistic in the above problem? Would 
curve fitting? What is the relation among r, and curve fitting? 

4. A sociologist wishes to make a preliminary test of his hypothesis that 
nationalities in urban commimities differ in respect to the time they allow 
to elapse before taking out their first naturalization papers. He suspects 
that the city in which they live and also the ecological zone within the city 
may be factors. With hypothetical figures (or real ones if you can get them) 
set up a Latin square to test this hypothesis, Lay off five cities as columns 
and, as rows, use zOnes between concentric circles centering about the down- 
town btismess district. How do you fit in the nationalities? 
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No. of columixs added correctly 


Subject 

Test 1 

Test 2 

Test 3 

Test 4 

1 

11 

15 

20 

17 

2 

40 

39 

37 

40 

3 

38 

38 

35 

40 

4 

35 

40 

39 

39 

5 

22 

29 

37 

34 

6 

32 

36 

39 

34 

7 

23 

24 

23 

26 

8 

23 

24 

20 

30 

9 

10 

16 

18 

17 

10 

23 i 

29 

30 

28 

11 

25 

28 

27 

31 

12 

18 

19 

22 

24 

13 

22 

27 

34 

33 

14 

14 

17 

17 

17 

16 

21 

30 

29 

29 

16 

20 

25 

31 

30 

17 

34 

33 

36 

37 

18 

38 

38 

40 

37 

19 

31 

39 

38 

40 

20 

26 

24 

29 

27 

21 

23 

28 

26 

31 

22 

26 

31 

26 

30 

23 

24 

25 

28 

26 

Means . . 

25.2 

28,4 

29.2 

30.3 


References for Further Study 

Fisher, R. A.: Statistical Methods for Research Worker Sj Oliver and lioyd, 
7th ed., 1938. (Slightly revised editions of this book hav(j been pub- 
lished at intervals of about 2 years since 1924. It is the parent book 
in this field, but difficult to read.) 

: The Design of JExperiments, Oliver and Boyd, Edinburgh, 1936. 

(A small book devoted to an exposition of how to set up (jxperiinents, 
primarily in agricultural research.) 

Irwht, J. O.: Mathematical Theorems Involved in the Analysis of Vari- 
ance/^ /. Boy, Statistical Boc., Vol. 94, pp. 284-^00. 

Rider, Paitl R.; An Iviroditction to Modern Statistical Methods, John Wiley 
& Sons, Ino., 1939. (Makes some attempt to give mathematical deriva- 
tions, but they are not very complete.) 

Snbdecor, G, W.; Statistical Methods, George Banta Publishing Company. 
(The most complete popularized account of analysis of variance and of 
the other phases of Hsheris statistics. Written chiefly for research 
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workers in agriculture. Indispensable to workers in that field and 
useful to others. It makes little attempt to show the mathematical 
foundations for the formulas, confining itself to an explanation of their 
use for persons of little statistical training.) 

Tippett, L. H. C.: The Methods of Statistics, Williams and Norgate, 2d ed., 
1937. (The clearest available explanation of analysis of variance with 
some attention to its mathematical foundations. In our opinion the 
best single book undertaking to popularize the Fisher statistics for 
persons of a moderate amount of statistical training. The book con- 
tains no tables.) 



CHAPTER XIII 

FURTHER METHODS OF CORRELATION 


In Chap. IV we treated the Pearson product-moment correla- 
tion technique and the Spearman ranks method, which latter is 
just a special algebraic adaptation of the product-moment 
formula. The Pearson product-moment formula is the best one 
to use where it can be applied. • But many situations arise in 
which it would be desirable to employ a correlation technique in 

which this formula is, for one 
JZL reason or another, not applic- 
able. In this chapter wc shall 
set forth several alternative 
^2 procedures, each adapted to 

“XT * some particular type of situ- 

“ ation. 


Fig. 23. 


BISERIAL CORRELATION 


We sometimes have our data given in the form of two mutually 
exclusive categories in respect to one factor and in quantitative 
scores in respect to the other factor. It is not difficult to develop 
a formula for the coefficient of correlation between the two 
factors under these conditions. In Table XXXI wo display such 
measures from a study by Soncs on the relation of size of family 
to the tendency of children to leave school before the age of 
eighteen. In column 2 is given the distribution of 200 chihlren 
who remained in school according to the size of the families to 
which they belong, in column 3 is given a corresponding dis- 
tribution for 100 children who had left school, while in column 4 
the totals are shown. We want the coefficient of correlation 
between size of family and tendency of the children to leave 
school. We shall lay off our situation graphically on the accom^ 
panying chart, AD is the straight line passing through the 
means of the two arrays. The* slope of line AD is the regression 
coefficient and, when multiplied by the ratio of the <t's of the two 
factors, becomes the coefficient of correlation. Letting j/a 

362 
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stand for DC, y\ for AB, £2 for OC, £1 for OB, and h for the slope 
of the line of the means, we have 

i, _ 2/2 _ 2/1 _ 2/2 + 2/1 

X2 Xx X2 + Xx 

This last term on the right comes from application of '^alterna- 


Tablb XXXI. — DiSTRiB-aTiON OF Children Who Remained in School 
AND OF Children Who Left School before Eighteen Years of 
Age, According to Size of Families^ 


(1) 

No. children 
in family 

(2) 

Remained 
in school 

(3) 

Left 

school 

1 (4) 

Total 

12 

2 


2 

11 

4 

3 

7 

10 

4 

2 

6 

9 

4 

8 

12 

8 

20 

3 

23 

7 

10 

17 

27 

6 ! 

24 

12 

36 

5 

18 

18 : 

36 

4 

30 

10 

40 

3 

34 

12 

46 

2 

34 

10 

44 

1 

16 

5 

21 

Means 

4.67 

5.31 

4.82 


^ Sonus, Elwood, “A Study of One Hundred Boys and Girls, Sixteen to Eighteen Years 
of Age, Who Have Left School and a Similar Group Remaining in School,” master^s thesis 
at Pennsylvania State College, 1933. 


tion” and “composition” (recall elementary algebra or geome- 
try). Now since r equals h multiplied by the a ratio, 

_ —I. <’■* _ 2^2 + 2^1 <’■» 

The (^2 + 2/x) is the total distance between the means of the two 
distributions, hence The (£2 4 - ®i) is the distance 

between the means of the two parts into which the distribution 
of pupils in respect to persistence in school is divided. We 
may reasonably assume that, in respect to disposition to remain 
in school, pupils make a normal distribution, and we have already 
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learned that the mean of the tail of a normal distribution from 
the mean of the whole distribution is 3/p, where % is the height of 
the ordinate of a normal distribution of unit area and unit 
standard deviation at the point of truncation and p is the propor- 
tion of the whole distribution in the tail (see page 289). There- 
fore, Xi equals g/p, and x\ equals z/g, so that 

«. + « = (- +i') = 

^ ^ \P ?/ V<1 

But (p -j- g) is the whole area of the distribution and, since wo 
are dealing in terms of proportion, is 1. Substituting 1 for 
(P + d, (®i + Xi) = z/pq. 

Ca = 1, since we assumed in calculating the z of the numer- 
ator that the x factor makes a normal distribution of unit area 

and of unit standard deviation. 
The standard deviation of the y 
factor can readily be found; it is 
the standard deviation of the scores 
constituting the sum of the two 
partial y distributions (here shown 
in column 4) and is to be computed 
in the customary manner. If the grouping is very coarse, Shep- 
pard’s correction should be made in the computation of this sigma. 
We are now ready to substitute in the r,® formxila above the 
several equivalents just found, and we have 



(Jlf,,, - M„)pq 


(Biserial coefi&cient of correlation) 


Let us now apply this formula to Sones’ data as displayed 
in Table XXXI. equals 5.31 and is 4.57. The propor- 
tion leaving school, p, is .33 while the proportion remaining is 
(1 — .33) or .67. The standard deviation of the distribution 
in column 4 is 2.57 and the z shown in our table (pa^e 482) for a 
tail of .33 is 0.3635. Substituting these values in the formula, 
we have 

r - (5.31 - 4.57) (.333) (.667) _ 

' (2.57)(0.3635) 
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Soperi giyes as an approximate value of the standard error of 
biserial r, provided q is not less than .05, the following: 



(Standard error of biseriaJ r) (188) 


The probable error would, of course, be .6745 times the standard 
error. 

The assumptions involved in the biserial r formula should be 
carefully noted. No assumptions whatever are made about the 
shape of the distribution in which the quantitative scores are 
found. But the assumption is definitely involved that this 
distribution is not mutilated in such fashion as to change its 
standard deviation as compared with what it would be in a 
random sample of the total population drawn upon. Normality 
is assumed in the distribution in which the dichotomy occurs. 
It is also assumed that the whole sample distribution is present 
and that the two tails fit together into a whole normal dis- 
tribution. In using the formula, there is great temptation to 
draw upon the upper and lower extreme tails and omit individuals 
from the middle of the distribution. If, for example, one is 
attempting to study by this technique the correlation between 
professional training and teacher success, it would not do to 
select 100 of the best teachers (constituting, say, the uppermost 
20 per cent of the whole teaching population) and the 100 poorest, 
for that would chop out the middle of the distribution and give 
r’s much too high. A method for dealing with such widespread 
dichotomies is given later in this chapter. 

The biserial r is really a very promising technique for research 
in education and in the psychological and social sciences. The 
following are illustrations of a few t 3 ^es of situations in which it 
could be advantageously employed: 

1. Having athletes divided into successful and unsuccessful 
and having measurements in a number of traits possibly related 
to athletic success, find the correlation of each of these traits with 
success. 

2. Having teachers similarly divided, find the correlation of a 
number of factors with teacher success. 

^ Sopna, Biom^rika, Vol. X, p. 890. 



366 


STATISTICAL PROCEDURES 


3. Having a large sample of motion pictures divided into 
“good” and “poor” (or perhaps “above average” and “below 
average”) from the standpoint of excellence in the technique of 
dramatic art and knowing the financial returns from each of 
the pictures of the sample, determine the correlation between 
excellence in dramatic art and financial success. 

4. Having measures of certain temperamental traits for a 
sample of divorced women and for a corresponding sample of 
women who are not divorced, ascertain the coefficient of cor- 
relation between each of these temperamental traits and the 
tendency to be divorced. 

Evidently large numbers of such problems could be formulated 
in various areas of research. 


TETRACHORIC CORRELATION 


A second type of situation is where we have our data in both 
variables merely in the foi’m of the number of individuals, or the 
proportion of individuals, in each of two categories. Thus wc 
may have a total population of teachers divided into “success- 
ful” and “unsuccessful” (meaning above or below a certain 
dividing point in respect to success) and have information that 
a of the former have taken courses in pedagogy beyond 6 hr. and 
6 of them have not, while of the latter c have had such courses 
Y H beyond the 6 hr. and d have not. Wo 


{ wish to find what correlation exists 

“ Kk* ° between success in teaching and the 

^ Th — I ^ taking of courses in pedagogy. We 

i j 1 ^ ^ 

d I c fold table, as indicated in Fig. 25. 

I The dichotomic lines are KK and HII, 

^ while the means of the distributions 

lie at XX and YY, respectively. In 
order to make our case general, we are not assuming that the 
dichotomies are equal but are allowing the dichotomic lines to 
lie at distances h and k, respectively, from the Tnp,a.Tia. 

As a foundation for approaching our problem, we must get an 
equation for the correlation surface where both of the two corre- 
lated arrays are assumed to be normal distributions. If is 


the frequency of y scores at any particular value of x, then, 
according to our formula for the normal curve given on page 286, 
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(A) 


2' = 


N 




e 2ir>, 


These y scores constitute a column which itself may be assumed 
to make a normal distribution with its mean on the regression 
line (assumption of rectilinearity of regression). The frequency 
of any y score in this column, when the y is measured from the 
mean of the column as origin, is 


(B) 


Nc 


^v^-\/2nr 


e 


where the Ne is the number of individuals in the column anfl 
the o-„. is the standard deviation of the column. We learned 
(page 113) that the standard deviation of a column in a correla- 
tion surface is Vl — times the standard deviation of the 
entire y distribution. The measurements of yc are taken, as 
said above, as deviations from the regression line. This point 
on the regression line for this column is r{cy/(T,^x distant from the 
mean of the whole y distribution. Therefore, in the case of any 


score, ye 




Making 


this substitution for the y* 


and <Ty-\/l — for <7y„ we have 


(CO 


z" = 


No 

<ry'\/^\/l — r* 


e 


2<rs,(l-r’) 


Equation (4) represents the number of individuals out of a 
total population of N that are to be expected in a given column 
of a normal distribution. Hence the proportion of chances a 
given individual has of being in that column is the value given oii 
the right of the equation divided by N, which would be the same 
expression with 1 as its numerator instead of N. Such fraction 
represents the probability that a given item will be in that 
column, and hence that it will have this particular x value. 
Similarly the expression at the right of Eq. (C) with 1 instead of 
Nc as its numerator represents the probability that, if a given 
item is in the column, it is in a ^ven cell in that column — ^has a 
given y value. Therefore the probability of an item being in 
a given cell — having a particular xy value — ^is the product of 



368 


STATISTICAL PROCEDURES 


these two probabilities, and the number of items that fulfill those 
two conditions is N times the fraction representing the joint 
probability. So we have, as the frequency of items in any given 
cell, 

— 2rxtfi^+r’^x' 

ffx <T^at 

2<ra„(l-r2) 


The exponent of the e will simplify, by straightforward alge- 
braic manipulation, and yield the following form: 

p = ^ (189) 

27r<r*(r„vT^ 

(Frequency in a single coll, nor- 
mal correlation surface for two 
variables) 

Suppose, now, we have our correlation surface divided into 
four quadrants, as depicted in the chart at the opening of this 
section, a, b, c, and d representing the numbers of individuals 
in the several quadrants. Then (a -f 6 -h c -b d) wotild obvi- 
ously equal N. Equation (189) gives us the number of indi- 
viduals within a cell of a given x value and simultaneously of a 
given y value. If we can sum for all the cells by quadrants, we 
shall have the frequencies constituting the entire population. 
Thus integrating from x — h-tox — infinity and from y = hto 
y — infinity, we shall get the population in quadrant a as our 
integral (for double integration see page 38). Correspondingly 
integrating from x = ktox — — « and from y — hto y — oo, 
we get d. Similarly we could integrate in the other quadrants 
to get b and c, while the sum of these integrals would yield the 
total population JV. In this integral the only unknown term 
would be r, and we could solve the resulting equation for r. 

But this is an extremely difficult integration to perform, and 
we shall not attempt here to follow it through. In a long article, 
Karl Pearson"' has performed the integration and has arrived at 
the following result: 

* PuiEsoN, Kakl, “On the Correlation of Characters Not Quantitatively 
Measurable,” Trans. Roy. 8oc. (London), Series A, Vol. 196, pp. 1-47, 
especially pp, 1-7. 


iD) 


Fa, = 


N 


-U 

j> L.2<rx^ 


2ir(rs<Ty\/l — 
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%tiad be) _ _ I „2 ^ 1 „3 ~ ~ 1) 

e r-f-r 2 -t-r ^ 

+ ^ hkih^ - 3(fc* - 3)) + (h^ - + 3)(A* - 6fc» + 3) 

+ ^ hk{h* - lOh^ + 15)(A:< - lOfc* + 15) 

+ (A® - 15A^ + 45/i* - 15)(fc« - 15k^ + 45A* - 16) 

+ hk(h'‘ - 21¥ + 105^2 - 106) (fc« - 2U* + 105A!* 

(Formula for tetrachoric correlation, 

— 105) + etc, dichotomic lines at k/<rx and h/vy (190) 

from the respective means) 


The k and the h here are measured in terms of <t* and or^, so 
that their values can be looked up in our table, page 481 ; they 
are simply the values given in the x/o-* column for g representing 
the proportion of cases on either side of the dichotomic line for 
each of the two correlated distributions. So r is the only 
unknown term in the equation. In solving the equation log- 
arithms must, of course, be used to find the value of the expres- 
sion on the left,^ and an approximation method must be employed 
on the right, as we shall illustrate shortly. 

Such a formula is really too complicated to be of much service 
in routine statistical work. We can simplify it by placing upon 
the situation certain restrictions. One of these is to place the 
dichotomic lines at the means (or at the medians, which is the 
same thing in the normal distributions we are obliged to assume). 
Then h and k will both equal zero, the e will have zero as its 
exponent and hence become equal to 1, certain terms will entirely 
disappear, and the previously complicated formula will simplify 
to 

2jr{ad — be) __ I I 9^* I 225r^ . 

m ^ 6 120 6,040 


^ Or the expression on the left of the equation may be put into simpler form 
as follows: 




jad — be) 


{ad — he) 
N^zz^ 


The z*s have here the conventional meaning, and their values may be looked 
up in our tables from the q^a of the two distributions. 
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The right-hand member of this equation can be found in a 
list of trigonometric series as the arcsine of r; i,e., it is equal to an 
angle of which the sine is r, the angle being measured in radians. 
It is likely to be found in such list in the form 


sin”"^ T 


+ 2 3^2 4 5 ^ 


1 3 6 
2'i'6' 7 


Therefore, by reason of the moaning of arcsine, 

r = Qni (ad ~ he) (Formula for tetraclioric r when the n 01 ^ 
I bin ^TT ^2 dichotomic lines are at the means) V 


The TT here is 180 deg. and iV is (a + & + a + d). 

As another scheme for simplification that does not compel 
equal dichotomies, Pearson, in the same article, develops certain 
empirical formulas that give approximately correct r^s, the mean 
error in 15 trials being less than 4 per cent. The simplest of 
these is the following: 

T a/s — a/6c formula for tetrachoric r, 

r = sin s dichotomic lines not neces- (192) 

V od + ^/ho sadly at the means) 

By taking advantage of the fact that the sine of an angle equals 
the cosine of (90 deg. minus the angle), we can put this formula 
into a little simpler shape. Remember that> since ir = 180 dog., 
90 deg. = 7r/2. Making this substitution, 


T == cos 



TT 

2 


■s/^ — V'6? \ 

+ V&c/ 


Combining within the parentheses, 


( ^/jc \ (Second formula for tetraohorio 

TT — 7 = I r, no restriction on position of (IQS') 

Vw + V6c/ dickotomic lines) '■ ' 

It is necessary to recognize the assumptions involved in the 
development of the formulas for tetrachoric r. These are the 
following: homoscedasticity, rectilinearity of regression, normal 
distributions in both of the distributions as wholes, normal 
distributions in the individual columns, and continuous rather 
than widespread dichotomies. 

The formula for the P.E. of tetrachoric r as given by Pearson 
in the original article here drawn upon is very complicated and 
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laborious to apply, especially for the general case. We ahalT 
give it below, without proof, and then follow through some 
approximations Pearson proposes by way of simplifying it. 


P.E.r 


0.6745 r (a + d)(c + 6) . (a + c)(d + 6) 
XoVN L 4i\r2 + W 


, ,3 (a + b)(d + c) 


+ 


ad — be 
JV2 


— 4'i 


db — cd 
JV2 


where 


- 'I'l 


ac — bd 


- J 


(General formula for the probable 
error of tetrachoric r) 


(194) 


and 


- 


1 

•v/^ Jo 


e ^ dx] ^2 = 


/8i = 


k — rh 
■\/l — 


;Pi = 


1 

V^jo ^ 
h — rk 
■\/l — r* 



Xo 


^ Vl 


Under certain conditions this formula greatly simplifies. If 
h and k are both zero, jSi = 182 = = ^2 = 0. Then everjrthing 

within the brackets will disappear except the first term, and the 
xo will be equal to 1/ (2ir\/l — r^), so that we shall have 

P.E.. = r (» + g(; + >) ]' (196) 

(Probable error of tetrachoric r when the dichotomic lines are at the 
means in both arrays) 

It can be shown by a process of algebraic and trigonometric 
transformations which we shall not reproduce here that, assuming 
a — d and h = c as would be the case when the dichotomic 
lines are at the means, 

(a + d)(c + b) _ /'sin-1 rV ] 1 

4JV* ~ L \ 90° / J 16 

Making that substitution in the formula above and chani^ng 
the 2 t to t/2 in order to compensate for the 4 placed as a multi- 
plier with the quantity for which substitution is being made, 
we have ai arrequivalent formula, 
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(Alternative formula for the P.E. of tetraohorio r when the dichotomic 
lines are at the means) 

If r equals zero but h and k have any values, then substitution 
in the general formula will show that 

p E , = / (a + i)(a + c){d + h){d + cj 

ztith'\/N V 

(Probable error of tetraohorio r when the true r is zero) 

0.6745 , 

For the important task of testing the null hypothesis, formula 
(197) is the one to use. This gives the basis for an answer 
to the question whether we might have obtained the r we have 
in hand by chance fluctuation in sampling when the true r is 
zero. This is the most frequent use we have for the standard 
error of r. Finally, if both h and k are zero and r is zero, sub- 
stitution in the general formula gives us 

__ 0.6745t (Probable error of a tetraohorio r of zero , 

F.E.r = — — when the dichotomic lines arc at the (198) 
2v N means in both arrays) 

Unable to find a way of simplifying the general formula, 
Pearson resorted to the empirical scheme of combining the 
formulas for the three special cases, multiplying togcsther formulas 
(196) and (197) and dividing by formula (198). This gave 
him an approximate formula which he found upon trial to give 
P.E.’s differing from the true ones at most by one or two units 
in the third decimal place. Tliis formula, as the reader can 
easily verify, is as follows: 


P.E.r - 


0.6745 

ZhZks/N 


4 


(1 — r®)(o + b)(a -t- c){d + b){d + c) 

N* 




(Approximate general formula for the probable error of tetraohorio r) 
1 Pearson, Biometnkc^ Vol. 9, pp. 23, 24, 
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The here have the customary meaning — ^the height of the 
ordinates of a normal distribution of unit area and unit standard 
deviation at the points of truncation by their respective dicho- 
tomic lines. The values of these can be found in our tables. 
The sin“^ r is the arcsine of r; i.e,, the angle of which r is the sine. 
Probable errors of tetrachoric r’s are of the same order of magni- 
tude as those of product moment r's of corresponding size and 
population, although the former are perhaps 40 or 50 per cent 
higher. 

As an illustration, we shall now compute the tetrachoric r 
for the hypothetical data given at the opening of this section 
about the relation of teacher success to the taking of courses in 
pedagogy. Let us say that of 135 
successful teachers 80 have had 
courses in pedagogy beyond 6 hr. and 
55 have not, while of 90 unsuccessful 
ones 20 have had such courses and 70 
have not. We shall first employ the 
complete formula, (190), in order to 
illustrate its operation and to ascer- 
tain how much the results from it 
differ in this problem from those 
obtained from the short formula. As 
a first step we drop all terms containing r beyond the second power. 
Using on the left the form given in the footnote, page 369. 

(5,600 - 1,100) , , (.253) (.141) 

(225»)(.395)(.886) -’’ + ’^ 5 

.582 = r + .0178r* 

Completing tlie square and solving this equation for r gives, as a 
first approximation, r = .577. 

Inspection of the signs of the additional terms on the right 
of the equation constituting the complete formula leads to the 
conclusion that this value for r is somewhat too high. Let us 
try .560, substituting this in all the terms on the right side of the 
equation. If the .650 is the correct value, we shall get on the 
right side of the equation .5823 to equal the same quantity on 
the left. But we get .5856, which is too mu^h. Let us try 
for r .648. This gives us on the right .5832, which is still a 
trifle too high. Try .547. This yields on the right .5820. 
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This has now passed below the value on the left but by only a 
trifling amount. The true r, correct to the third decimal place, 
is therefore .547. On pages 501 to 504 we give tables to facilitate 
these calculations. 

Let us next apply to the same data the cosin t formula. 


_ Vfc Vmoo 

r = cos — 7 = 7 = TT = cos — > ■ : y-' : loU 

v ^ + Vbc V5;^ + -v/mm 


= cos 65°17' = .569 


The probable error of this r by formula (199) is 
E 0-6745 

■' (.395) (.386) 

/(I - .5692) (135) (100) (125) (90) r. /34.72“Y ' _ 

V 225^ I V 90“ j J “ 


The P.E. of a product moment r of the same size and popula- 
tion would be .03. 

Thus, while for r we get the value .547 by the long formula 
and .569 by the short one, a difference of .022, that difference is 
less than half of the probable error. The result from the short 
formula is, therefore, quite good enough. 

The tetrachoric formulas are especially valuable in case of 
characters not measurable in definite quantitative ways but in 
which we can make broad distinctions — such as between persons 
who have left school and those who have not left, persons who 
have been retained on a job and those who have been discharged, 
persons who are above average and those who are below average 
in success, etc. Nevertheless the formulas can be applied to 
quantitatively measurable factors by making dichotomies at 
the medians or at any other fixed points, regardless of whether 
those points correspond in the two arrays. But in this case 
the worker must not be surprised to find an r computed by the 
tetrachoric formula to differ appreciably from the one he would 
get from the same sample by the product-moment method. 
The differences between r’s computed for the same sample by 
these two methods may be as great as r’s from different samples 
by either one of the methods, or nearly as much. This is partly 
because the assumptions involved in the tetrachoric method may 
not have been fulfilled, and partly because of chance arranjge-' 
ments within the quadrants which affect the product moment r 
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but not the tetrachoric one. Apart from the question of non- 
fulfillment of the assumptions, it is when the population is 
relatively small that the tetrachoric r is likely to differ most 
widely from the product-moment one. 

TETRACHORIC r FROM WIDESPREAD CLASSES 

When working with the correlation methods discussed in the 
two preceding sections, it is not always convenient to deal with 
the whole distribution divided into two parts; it is often much 
more convenient to deal with widespread classes. If, for 
example, we wish to find the correlation between pedagogical 
training and eflGiciency in teaching, it is the most economical and 
tempting procedure to take a sampling of the best teachers and a 
sampling of the poorest ones rather than to consider all. But 
none of our conventional correlation 
formulas apply to such a situation; 
they all demand the presence of full 
distributions. For years the authors 
have experienced the almost desper- 
ate need in research for such a for- 
mula, which would give correlation 
coefficients of the same meaning and 
value as the product moment r’s and 
yet permit operation only with the 
extreme tails of one of the distri- 
butions. To meet this need we have developed the following 
formulas. 

For tetrachoric correlation from widespread classes we have 
a situation like that represented in the accompan3dng diagr am , 
our individuals located in quadrants but an open gap between 
lines K\Kx and K%Ki. We may integrate for the correlation 
surface from hi to infinity and from h to infinity to get a. This 
integral will not differ at all from what it would be if the whole 
surface were present, because the integration is fmm the dividing 
line outward and not across the vacant middle. When put in 
terms of proportion of the entire population by dividing by N, 
this integral will be 
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Since the e under the double integral sign has as exponent 
the sum of two terms, it may be separated into the product of 
two integrals, so that Eq. (E) may be written as follows: 


(F) 



— ^ nr 1 r 1 

e ^ dx e ^ dy + Zk^ZhS 


Now examination will show that the first of those integrals is 
the summation of the z’s (and, consequently, of the probabilities) 
in the x distribution from &2 to infinity and hence the tail of the 
X distribution from ki to infinity, which we shall call p*,. The 
second integral is, similarly, the tail of the y distribution, which 
we shall call Ph. Making these substitutions, and making some 
algebraic transformations, we have 


(G) 


^ - P..PA + 




The S is the slowly converging series given ai^ the right in 
formula (190) and which we here restate in abridged form. 


a-Np,p, _^ ,hk 

NzjcZh 2 6 

hk(h^ ^ ^ 3) 

24 


The N of this formula we are likely not to know except by impli- 
cation. But we do know the number of individuals in the four 
quadrants so far as the remaining tails include them, and we must 
know the proportion of the whole population included in each 
tail. We may, therefore, put N in terms of these directly known 
elements as follows: 

(a + c) = phaN; (& + d) = pkxN] so (a + 6 + c + d) 

— N (pki + Pki) 

Therefore, 

jy s= Q 4“ 5 + c + d 
Pm + Pkt 

Making this substitution in formula (G) and letting 
(a + 6 + c + d)~?i 

instead of N which stands for the whole population of the 
unmutilated distribution, we have 
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a(Ph, + Pm) - npkjph ^ ^ 

nzk^k 


( 200 ) 


Similarly integrating for d from x = ki to x = —» and from 
y — h toy = — 00 , we have 


djpki + Pkt) — npkiqh _ g 
yiZk^Zk 


( 201 ) 


The qh at the right is used in the ordinary sense: it is (1 — y). 
Note that cognizance must be taken of the sign of h and of k, so 
that ^ of formula (200) does not have the same value as of 
formula (201). It is advisable to take two determinations of r, 
one from formula (200) and one from formula (201), and accept 
as the true value of r the geometric mean of the two. However, 
if the assumptions of the development have been fully met, the 
two values will be identical. 

Suppose, now, that the two tails of the x distribution are equal 
and that the dichotomy in the y distribution is at the mean. 
Then ki will equal fca, h will be zero, p* will be Zh will be 
and /S and Si will be identical in value. We may then advan- 
tageously combine formulas (200) and (201) and have 


^2op*,-s/2ir 


Pfe’%/271 

2z* 


'^2dpfeV'2T 


2z* I 




If our assumptions have been fully met that the tails are equal 
and the dichotomic line dividing the y distribution is at the mean, 
o would equal d and h would equal c. But, for reasons of unequal 
sampling at the two ends, if for no others, this will seldom be 
precisely the case in empirical samples. Let us, ^erefore, take 
-y/^ for each a and d, 2-\/bc for (6 -J- c), and 2 \/ ad for (a d). 
Then we would have 


(D 


Pk’s/^TT r 2-\/ ad — ^(a d -4- b H~ c) ~| 

L a + d + 6 + c J 

Pk-\/^ r 2Vad — — V^ 1 

2* L 2\/od + 2-\/fec J 


PibV^ ^ -y/od — V&c 
2z*i y/ad + y/bc 


= 8 ' 
= 8' 
= 8 ' 
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We shall now substitute the value of /S' for the special condition 
where the dichotomy is at the mean of the y distribution, and 
hence where A = 0, and have the following formula: 

. VM - V&C _ „ _ /T.2 _ IN 

22. + VTc 6 

+ - 6 A* + 3) - ^ (A« - 15A^ + 45A“ - 15) 

+ 3 -^ (A® - 28A« + 210A^ - 420A* + 105) 

- (Aio - 45A8 + 630A« - 3,150A* + 4,725A2 - 945) 

+ (Ai» - eeAi® + 1,485A8 - 13,860A« + 51,975A« 

- 62,370A^ + 10,395) - (A^^ - 91Ai2 + 3,003Ai'> 

- 45,045A« + 315,315A« W,945A" + 945,945A2 - 135,135) 

+ i 75 ;^ 4 o - 120A“ + 5,460Ai^ - 120,120Ai“ 

+ 1,351, 350A8 - 7,567,560A« + 18,918, 900A< - 16,216,2bOA* 

(Tetraohoric coefficient of correlation 
when one series is divided at the 

+ 2,027,025) — • • • mean and only symmetrical tails (202) 

remain from the other distribution, 
the entries being in frequencies) 

The series continues infinitely. We have given it at this 
length to indicate its behavior as terms are added, but seldom 
will the practical worker have occasion to use more than the 
first three terms on the right. In fact we shall give below a 
scheme that requires the practical worker to use only the first 
power of r and permits him then to ascertain the vahie for the 
whole formula from our tables. Obviously the scries will con- 
verge rapidly for low r’s, but for high r’s it converges extremely 
slowly. In order to get reasonable convergence for r’s of .96 to 
.99, several times as many terms must bo employed as wo have 
given. In making our tables in the Appendix we were obliged to 
carry the formula to the hundredth power of r in order to handle 
the high r’s. 

The A is found in the table for any proportion we wish to 
retain in each of the tails, this proportion being the p of our 
formula. The A is the distance from the mean of a normal 
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distribution of unit area and unit standard deviation to the 
ordinate that cuts off the required tail, and it is labeled x in the 
terminology of our tables. If a tail of 15.87 per cent (practically 
16 per cent) is employed, k will equal 1, and hence the second 
term on the right of the equation will vanish leaving the first 
power of r and powers beginning with 5. Unless r is rather high, 
these powers of r of 5 or greater may safely be neglected. 

Although we shall offer below a short-cut method, we shall 
illustrate the operation of this formula for the sake of making 
the principle clear. Out of a total student body of 1,257 mem- 
bers^ 156 of approximately the best 16 per cent in scholarship 
had accomplishment quotients above the average, while 54 had 
AQ's below average. On the contrary, of the poorest approxi- 
mately 16 per cent in scholarship 31 had AQ^s above average and 
184 below. In this instance, contrary to what would ordinarily 
be the case, we know the precise percent- 
age in the tails, because we measured the 
whole population for another purpose; it 
is 16.9 per cent. But extremely small 
errors are involved in the resulting r from 
slight discrepancies in estimating the per- 
centage in the tails under conditions where 
that percentage cannot be precisely meas- 
ured. The k for 16.9 per cent is 0.9581, 
which is so nearly 1 that no appreciable 
error would be involved in taking it as 1 for the sake of simpli- 
fying the arithmetic. For the first approximation we shall use 
only the first power of r, 

r = •169V^(V184 • 156 - VsTlT) _ 

^ 2(0.252) (^184 • 156 + \/54^) 

This is the value of the quantity on the left side of our equation, 
formula (202). The total value on the right must exactly bal- 
ance this when we take account of all the terna. In order td 
compensate for the additional terms, we would need to carry on a 
process of approximation precisely similar to that illustrated 
on page 373. But, when we try substituting .514 for r in the 
first five terms of the equation on the right, we obtain for the 

1 Phtbbs, 0. 0., “A Method for Computing Accomplishment Quotients 
on the High School and CMege tjevels,’* /. Edue. Res., Vol. 14, pp. 99-111. 
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value of this member of the equation .5138, while substituting 
.513 gives us .5128; so that .513 is the closest wo can get with 
three decimal places, and our first r required no correction. 
The Pearson product moment r, computed from the whole 
population, is .511, which is in remarkably close agreement with 
that given by our formula. 

We have employed here a problem resulting in a rather low r, 
hence the series converged rapidly, so that wo obtained a precise 
determination by using only the first few terms. But unfortu- 
nately the series converges very slowly for high values of r, 
so that it may be necessary to substitute in the formula through 
so many terms as to become impractical. Wo have, therefore, 
provided tables (pages 505 to 507) for reading values of the r’s 
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for the completed formula from those 
obtained by solving the equation for 
only the first power of r. The use of 
these makes wholly unnecessary the 
method of successive approximations 
just illustrated and makes the computa- 
tion of any r an extremely simple process. 
Suppose, for example, we have the 
fourfold layout indicated on the right, 
the p for each tail being 12 per cent. 


Dropping all terms in r except the first, we have 


/ = •12v^(V9F95 - VT'W ^ giQ2 
2(.20)(v' 90 • 95 -h V8 • 10) 


Entering Table L with p = 12 per cent and following down 
this column, we find .6185 as the nearest value. Interpolating, 
we get as the corresponding true r, correct to 3 places, .65 i. 
For r’s below .25 no correction is needed; unless extremely high 
accuracy is required, the value obtained from solving for only 
the first power may be taken as the true r. But for r’s above 
.50 or .60 (depending much upon the percentage in tho tail) 
the correction is important, and the more so as the r’s approach 
unity. 

Two Pennsylvania State College graduate students made 
empirical tests of this tetrachoric formula. C. E, Amos made 
78 determinations of the tetrachoric r’s in accordance with the 
conditions of the formula, and of the corresponding product 
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moment r’s, with populations of from 128 to 802. The average 
deviation of the tetrachoric r’s from the product-moment ones 
was about 7 per cent. The most extreme divergence was five 
product-moment P.E.’s; but prevailingly the deviations stayed 
within one P.E. R. W. Jacks tried departures from the condi- 
tions of the y dichotomy at the mean and from equality of propor- 
tions in the tails and nevertheless used the formula that assumes 
these conditions in order to see how far we may depart from the 
assumptions and yet get satisfactory results. He took as p 
the geometric mean of the two p’s and as the z the geometric 
mean of the two involved in his data. Out of 87 determinations, 
he found no substantially greater error than that by Amos when 
imposing the conditions assumed in the development. We may, 
therefore, depart somewhat from the assumptions of our develop- 
ment and yet have substantially correct results. Our formula 
would then be 

2'\/zhiZk, vod -t- -vbc 

where S' is the value given at the right of the equality sign in 
formula (202). 

But if the dichotomy in the y distribution differs more than 
moderately from the meah and reasonably accurate results are 
required, it is best to use formulas (200) and (201) rather than 
(203). In that case the formula must be solved for two quad- 
rants by the method of approximation illustrated on page 379. 
But in order to lessen the labor of such calculations, we have 
set up values for the quantities in parentheses for all tails from 
5 per cent to 40 per cent and up to the 25th power of r. These 
tables are found m the Appendix, pages 501 to 504. Suppose 
in some particular problem p*, is 25 per cent and ph is 33 per cent. 
The tables need make no distinction between pj and pj. We look 
in the table for the coefficient as determined by the pi and at 
another place in the table for the coefficient as determined by pv 
In the case of our illustration these would run as follows: 

r + (0.4770) (0.3111)r* + (- 0.2225) (-0.3292)r* 

-I- ( -0.3504) (-0.2520)r« 

But one must carefiolly observe that if either the h or the k is 
negative, the sign of its part of the coefficient is reversed as 
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compaxed with the signs in the table in all oven powers of r 
but not in the odd powers. If the h and the k in the quadrant 
with which we are operating lie in the same direction from 
their respective means, the sign of the combination is plus; other- 
wise it is minus. But a little experience will show that the r 
must reach at least .16 before carrying the r’s beyond the fii-st 
power will affect the third decimal place and beyond .20 before 
the second decimal place will be affected. When the r reaches 
.80 or .90, the equation must be solved through a considerable 
number of terms. 

P.E. OF TETRACHOBIC r FROM WIDESPREAD CLASSES 

We have not yet developed a satisfactory general formula 
for the probable error of tetrachoric r from widespread classes, 
but we submit tentatively the following one. It is for r', the 
value when all but first powers of r are dropped from formula 
(202). But r' may be regarded as r(l — j), where (1 — j) is 
the value obtained by dividing the series at the right by r. 
Thus, since r is a function of r', the P.E. of the latter is a proper 
basis for inferring the P.E. of the former. 

Since we assume the dichotomy of the y distribution to be at 
the mean and only symmetrical tails remaining in the x distribu- 
tion, we can put formula (202) into the following form: 

t t P'N/2jr 

where ce = (o -f d)/«. and ^ = (6 -f c)/n, the n being the number 
of individuals in the two tails combined. Then 

The is a constant. Let m represent it. Then 
Sr' = m5(a — /3) 

Squaring, su mm ing, and dividing by the number of samples, 

^ q- 2^' _ 2 

-s V -S ^~T~) 

Therefore, 
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It is obvious that rajs = —1, for the population remaining in 
the tails is divided into only those two parts, so that as the one 
increases the other must decrease. Therefore 

But (a + j8) =1. Applying, therefore, the formula for the stand- 
ard error of a proportion; tr* = -y/ap/n. Similarly = -y/a^fn. 
Thus, since <ra is found to be equal to v/j, we have, by substituting 
in our last of' formula above, o-?' = 4mV\. Replacing m with 
its equivalent and taking the square root, 

(/) IS 

We may now replace a and ^ with their values in numbers of 
individuals, and, by substituting these in (J), we have 

( 204 ) 

Zhy / ^ ^ spread classes) 

P.E. 0-6745py^ /(a-bd)(b + c) 

Si's/ n \ 

By some algebraic manipulation based on the fact that {a + 0) 
equals 1, we can put formula (204) also into the following form, 
equivalent to (204) except to the extent to which the assumption 
of symmetry in the tails and division of the y distribution at 
the mean is violated: 


By formula (204) the P.E. of the r' of .513 computed on page 379 
would be 


.169V^ 0.6745 /(156 + 184)(31 + 54) _ „„„ 

P.B.^ — V m - 


By formula (204a) this P.E. would be 


0.6745 

0.252 2 


- - .021 


P.E.,. 
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The above are formulas for the P.E. of r'. But r is a function 
of r', so that we may find the P.E.r directly from P.E./. We 
may symbolize the procedure in the following formula: 

P.E., = iW + P.E./) - fir' - P.E./)] (205) 

In verbal directions this means that we look up in our tables in 
the Appendix the r corresponding to (r' plus its P.E.) and again 
the r corresponding to (r' minus its P.E.) and take for P.E., 
half the difference between these two. For any multiple a 
of one P.E. we would need to take l/2a times the difference 
between the r function of (/ + a • P.E./) and of (/ — a • P.E./). 

In the case of an / as low as the one of .513 of our illustrative 
problem there will be a negligible difference between P.E., and 
P.E./. ' But we shall make the translation anyway for the sake 
of illustrating the procedure. 

The r corresponding to an / of (.513 + .022) for a tail of .169 
is .535, while that for (.513 — .022) is .491. Therefore 

P.E., = ^(.535 - .491) = .022 

BISERLAi r FROM WIDESPREAD CLASSES 

We shall now develop a formula for biserial r from widespread 
classes to match the one just presented for tetrachoric correla- 
tion. There are many situations in which such formula may be 
extremely useful in educational and sociological research; for 
example, where we wish to investigate the relation of teaching 
success to certain measured personality traits, or of attendance 

at movies to conduct outcomes, 
or of marital success to certain 
measurable factors, where we 
can have distributions of scores 
on the factors we wish to corre- 
late with our criterion but where 
it is feasible to investigate in 
detail only those extremes of the whole population which are 
outstandingly “high” in the criterion trait and those which are 
outstandingly “low.” 

Eeferring to the diagram, let pi be the proportion in one of the 
tails and ps the proportion in the other tail. Then, using the 
same graphical relations as those employed at the opening of 
this chapter, 
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tinbnrred and refer to the distances from the mean of the whole 
distribution to the points of trimcation. 

In solving a practical problem, we must first find the b for our 
particular problem, for which the value, as indicated on page 
385 is 


j _ (Ms — Mi)piP2 
P2Z1 + PiZi 


Then, armed with this information of the value of b, we deter- 
mine the value of <Ty by the use of formula (208) or one of its 
variants. Finally we use formula (206) to find biserial r. The 
r will merely be the b divided by <r„. Remember that xi will 
customarily have in its own right the minus sign, which will 
be offset by the minus in the term —XiZi of Eq. (208) and similar 
expressions above. Thus, if neither tail is greater than 50 per 
cent, both final xz products will be positive. Unless the worker 
watches his step he may get confused on this point. 

Besides normality in the total distribution of the population 
in both variables, this formula assumes sharp truncation of the 
tails. Such sharp truncation is -possible if we have actual 
measurements in the criterion factor. But sometimes we must 
merely estimate whether or not individuals belong in the cate- 
gories with which we are working, in which case the reliability 
of the r is lowered. This is merely because of the unreliability 
of measurement in the criterion factor and affects our problem 
in the same manner as unrehability of measurement always 
affects correlation. 

We shall now use as a practical example of this procedure 
the same study employed in our section on tetrachoric correlation 
— correlation between grade-point averages and accomplishment 
quotients for 1,257 college students. We shall display the muti- 
lated correlation table shown on page 387, all that middle section 
of students who made grade-point averages between 1.00 and 1.99 
being eliminated from consideration. 

Working with these data with intervals as units above the 
mid-point of interval .30— .39 as assumed mean instead of with raw 
scores, we fihd for the 294 students (23.4 per cent) who had made 
grade-point averages of 2.00 or better a mean of 7.846 and SFl 
of 19,365, while the 215 students (17.1 per cent) who had made 
grade-point averages below 1.00 had average AQ’s of 4.340 and 
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Table XXXII. — Accomplishmnt Quotients op “Good” and “Poor” 

College Students 



Average grade points 

AQ 

fYt 

Below 1.00 

fYi 

2.00 and above 

2.00-2,09 

1.90-1.99 


2 

1.80-1.89 


2 

1.70-1 79 


3 

1.60-1.69 


3 

1.50-1 59 

1 

7 

1.40-1.49 

1 

9 

1.30-1.39 


23 

1.20-1.29 

3 

34 

1.10-1.19 

8 

67 

1.00-1.09 

18 

70 

0.90-0.99 

8 

50 

0.80-0.89 

50 

21 

0.70-0.79 

59 

3 

0.60-0.69 

37 


0.50-0.59 

21 


0.40-0.49 

6 


0.30-0.39 

3 


Totals... .. 

215 

294 


of 4j807. Our first task is to find h and then a-y from these 

data. 


, {Mi - Mi)pips _ (7.846 - 4.340)(.171)(.234) _ , 

P 2 ZX + P 1 Z 2 (.234) (0.2640) + (.171) (0.3066) 

"4,807 + 19,365 + 

5^ [7.846 + 4.840 + 1.254 (9^ - 


(r„ = 


609 


(215)(4.340) + (294)(7.846) y „ 

509 -r I « V 

. 1 or 4 A 2540 .3066M 

+ 1-254 


1.254* 


.171 + .234 


[(0.2640) (0.9602) + (0.3066) (0.7267)] = 2.283 


1 * 


^ _b,._l:2^_ riQ 

““ rft nr>o *049 


(Ty 2»2l83 
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In this case we happen to know the mean, the standard 
deviation, and the r as computed from the whole population, 
and we went the roundabout way of inferring these merely for 
the sake of illustrating the procedure one would need to follow 
if he were not fortunate enough to know the (t. The correct a is 
2.301 (in intervals) instead of the 2.283 we obtained by inference, 
and the correct r is .533 when corrected for broad categories as 
compared with our .549. Inspection of the complete correlation 
chart reveals that the regression is slightly curvilinear and 
this violation of the assumptions back of the formulas threw 
us oflE a little. But the discrepancy is less than one standard 
error, and this is no greater than could be expected from r’s 
computed from different samples. In fact it must be expected 
that the extremes of distributions will differ in relation to their 
own distributions as wholes in somewhat the same manner as 
the regression lines of successive samples differ from one another, 
so that r’s computed from widespread classes may bo expected 
to diverge from corresponding ones computed by the product- 
moment method to a degree comparable with the fluctuation of 
r’s by either method from sample to sample. But the average 
of the r’s from a number of samples may be expected to bo the 
same by both types of method, and in any one sample the 
chances are just as good, of approaching the true r closely by the 
methods of these last few sections as by the product-moment 
method — or perhaps a little better since the P.E.’s of the 
former r's are smaller for the same number of actually utilized 
individuals. 

Formula (208), where we must infer both the moan of tho 
distribution and its standard deviation from a few fragments, 
requires considerable penciling, as the reader had probably 
noticed to his horror. Of course, no one in his senses would 
use that method if his data permitted him to compute a regular 
Pearson product moment r. But the labor of penciling in the 
application of this formula is trifling compared with that which 
might be involved in testing, or otherwise investigating, the great 
middle bulk of the distribution. 

The foregoing example was intended to show how to infer the 
standard deviation when it is unknown and then to compute the 
biserial r. Following is a typical example of the many potential 
uses of this formula in practical research. In it the a of the whole 
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population is known. After presenting it, we shall derive 
formulas for the standard error of this type of r. In order to 
test the validity of the Bemreuter Personality Inventory, Krupa’^ 
gave to 450 freshmen at Pennsylvania State College a verbal 
description of a neurotic person and a verbal description of a 
stable person (in addition to similar treatment of other traits). 
He asked these freshmen to write the names of freshmen of their 
acquaintance who were much like the persons therein described. 
Twenty-one subjects were named as neurotic three or more times, 
and 39 as stable. All the freshmen had previously marked 
the Bemreuter Personality Inventory. Thus Krupa had the 
distribution of the neuroticism scores for the 4.66 per cent of his 
subjects who most impressed their fellow students as neurotic, 
and also the distribution of these BIN scores for the 8.67 per cent 
who impressed their fellow students as most stable; and he knew 
the standard deviation of these BIN scores for the whole 460 
students. That the neuroticism mean of the scores for the former 
group was higher than that for the latter showed some validity 
in the Bemreuter inventory. To put the extent of that validity 
into standard correlation language, Kmpa applied formula (206) 
as follows: 

^ _ (Af2 - Mi)PiP2 

(PlZs + P23i)v» 

(68.19 - 31.00) (.0867) (.0466) 
[(.0466)(0.1578) + (.0867) (0.0977) ]30.06 “ 

We need, now, a standard error for this r. The standard 
error when the true r is zero will serve a useful purpose, because 
it will enable us to test whether fluctuations of sampling could 
be expected ever to yield so large an r as the one obtained if the 
true r were zero. The derivation is easy. The formula for r 
can be expressed in two parts as follows: 


n* = 


ViVi 

(piZ2 + Pa2i)<r» 


• (ilf2 - Ml) 


Except for a very slight sampling fluctuation of a, which we 
shall ignore, the first of these parts is a constant in a universe of 
samples from a certain population, so that the standard error is 

> Unpublished master's the^ at Pennsylvania State College, 1939. 
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merely this constant times the standard error of tho diff('r{>nco 
between means assuming the null hypothesis. This [formula 
(101), page 178] is 




\nj 111 \ niTii \ 


N + P 2 N 


PiP^N'^ 


Pi + P2 
P1P2N 


The a- is that of either class in the tails of the distribution. But, 
since the correlation is assumed to be zero and hence the slope 
of the regression line is zero, this cr will be the same for both 
tails and the same for all columns in the complete correlation 
table, and hence the same as the of the whole distribution. 
Taking the product of the two parts and taking account of thc^ 
relation between c and 5^, we have the following: 




bUi 


VpiVi 

(pizs + psZi)\/2i - 1 


V(Pi + Pi) 


(The standard error of biserial r 
from widespread classes when 
the true r is zero) 


(209) 


Substituting in this formula the values from Krupa’s study, tho 
standard error of his r is 


V (.0867) (.0466) 

(.0466) (0.1578) + (.0867)(0.0977)V'450 - 1 


\/-0867 + .0466 

= .069 


The obtained r is 4.6 times its standard error; so the probabil- 
ity that it could have arisen by chance fluctuation when the true 
r is zero is extremely slight. 

For many purposes, including the one typified hero, we need 
also the general formula for the standard error of tins r. Both 
its derivation and its application are more complicated. It fol- 
lows along the same general lines, but we caimot assume that 
the sigmas are equal as we could in the case above. The neces- 
sary standard deviations can be put in terms of known parameters 
and then put through a series of algebraic transformations, result- 
ing in the foUowing:*^ 

^ When the two tails come together so as to make a continuous distribu- 
tion, our formula (209) reduces to Soper’s, (188), where the true r of aero is 
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"■’•bu = 


Vpiyg 


(Pizs + PizOVN 


(pi +P 2 ) - 


P2Z? ^ Pl£| PiXiZi 


Vl 


P2 


Pl 


(General formula for the standard error 
of biserial r from widespread classes) 


For Krupa's problem this works out as follows: 


P2 ) 
(209a) 


V(.0867)(.0466) 


[(.0466) (0.1578) + (.0867) (0.0977)] V450 


(.0466 + .0867) 


.316® 


'{X 


.0867) (0.0977)2 , (.0466) (0.1578)2 
(.0466)2 (.0867)2 

(.0867)(1.6781)(0.0977) (.0466)(1.3616)(0.1578)' 

(.0466) (.0867.) 


= .066 


Siace at this point r’s do not distribute themselves normally 
about a true value, the type of interpretation employed on 
pages 135 to 139 is not strictly applicable; but its use does not 
distort the meaning too much for practical purposes. Employ- 
ing that type of interpretation here, the od^ are about two to 
one that the true validity correlation coefficient in relation to 
this kind of criterion lies somewhere between .316 minus .066 
and .316 plus .066; i.e., between .250 and .382. 

It is worth noting that the standard error of a product moment 
r with the same actually employed population {i.e., 60) would be 
•116, which is nearly twice as high as the .066 of our biserial 
r from widespread classes; and that of a biserial r with a con- 
tinuous population of size 60 divided at the middle would be 
.149. This suggests the economy of working with widespread 
classes where feasible. 


MEAN-SQUARE CONTINGENCY CORRELATION 
Another form of correlation which has been used to some 
extent is one based on x®- On pages 414 to 418 we show how 
to compute x® from a contingency table. Our interest there is in 


substituted in bis. For a oontinuous distribution, formula (209a) gives 
results very close to Soper’s but does not reduce algebraically to his. That 
is because both Soper's formula and ours make certain assumptions and 
approximations, though not the same ones. Bepause of the space required 
for the printing of the complete derivation of our formula, we cannot publish 
it here. The derivation is given in an article by the senior author (Peters) 
in Paychometrika for August, 1941. 




392 


STATISTICAL PROCEDURES 


determining whether chance fluctuations alone could explain the 
relations which appear to exist in the table; t.e., to test the null 
hypothesis. But a positive measure of correlation can be 
based on these same calculations, getting a measure which 
is designated by C and called the mean-square contingency 
correlation: 


/-! _ / (Mean-square contingency 

^ ^ coefficient) 

This measure of correlation is particularly fitting for materials 
which do not lend themselves to arrangement in categories 
that can be certainly said to be quantitatively ordered, or where 
the distances between the intervals are not susceptible of definite 
quantification. C varies between 0 and 1. But it does not, 
in itself, indicate the sign or the character of the regression. 
This must be determined by inspection. Karl Pearson showed 
that, if the items are capable of interpretation as a quantitatively 
ordered series, if the distributions are normal, and if the regres- 
sion is rectilinear, C becomes identical with r as the number of 
categories is indefinitely increased. But, since these assump- 
tions arc usually so far from fulfillment and since C is fairly 
laborious to compute compared with other forms of correlation, 
we do not regard it as a particularly useful form. Tetrachoric r, 
or the form we shall discuss later in this chapter, will ordinarily 
serve the same purpose better. 

On pages 416 and 416 some data by Burgess and Cottrell on 
marriage adjustment in relation to level of education are used to 
illustrate application of the x* technique. We shall hem draw 
upon the explanation and the calculation of x® which is given 
there. For this problem x® = 36.9, and N is 613. Hence 


^ “ 's/i 


36.9 


36.9 + 613 


.25 


The formula which Pearson gives for the standard error of C 
is somewhat laborious to apply, and we are not explaining it here. 
The interested reader will find it in Kelley’s Statistical Method, 
page 369. 

The maximum size of C is limited by the number of categories 
into which the distributions are divided. It can easily be shown^ 

‘ See the lithoprinted edition of this hook, p. 288. 
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that the maximum value C can have when computed from a 
square contingency table with t rows and t columns is 

Thus, even though we know the correlation is perfect, our formula 
cannot give us a higher correlation than \/{t — l)/i, which is 
.866 in the case of a 4-category table. Even in a table with 
15 categories in each array the maximum correlation can be 
shown, by substituting 15 for t, to bo only .966. In our next 
section we shall show how to correct for this, at least in part. 

CORRECTING COEFFICIENTS OF CORRELATION 
FOR BROAD CATEGORIES 

The coefficient of mean-square contingency is not the only 
coefficient of correlation that is left too low when computed 
from a tabic with broad intervals. The same thing is true of all 
correlations. It is true of every product moment r calculated 
from a correlation chart as compared with the r calculated from 
the paired scores. A correction is really called for in every r 
calculated from a correlation table where the scores are grouped 
in intervals wider than one unit, and it is imperatively called for 
whenever the number of categories is at all small — say below 
ton. We shall, therefore, attack in general terms the problem 
of correcting a coefficient of correlation for broad categories, then 
return to the application of the technique to the C of the above 
section. 

Wo shall first treat the case in which our classes are taken as 
centered about the means of their respective intervals; then 
afterward we shall take up the case, familiar to us in customary 
correlation work like that discussed in our Chap. IV, in which 
the items within an interval are regarded as centered about the 
mid-point of the interval. 

Let the unprimed letters stand for values centered around the 
means of their intervals while the primed letters stand for the 
variates themselves. Then r,* is the correlation in terms of 
intervals, while r*-/ is the correlation when all the variates are 
taken at their actual values. We want to find r^y' in terms of 
rag. We shall employ in simple form the technique of partial 
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correlation treated in a preceding chapter. On page 243 the 
reader will find the formula 


— rot — rogria 

Vl - rfaVl - ’•oa 

We shall let the 0 be Xj the 1 be 2 /, and the 2 be x'. Then 


** ** y/i — — J’L' 

The Txu-t! is the correlation between z and y with the z' variates 
leld constant. But, if the z' values are hold constant, the z’b 
.vould be constant, since the a:’s are the means of the a:"s by 
intervals. Because any variable correlated with a constant 
gives a zero correlation, r^ys! equals zero. So we have 


Txy ^ q 

Vl - rlx'Vl - ’•L' 

Multipl 3 nng through by (\/l — rJ/Vl ~ ’'Ix')) we get 

rxi, - rax-ryx- = 0 

and transposing, 

Txy ^ 

We should like to be rid of the Vy^f, so we shall try another 
partial correlation. 

r , — Tg/yffyyf 

Vl - J'w'Vi - rjy 

This partial r is the correlation between the j/’s and the ®"s 
with y' held constant. But if the y' is constant, the y must be 
constant for the same reason as given under the a:’s. So our 
partial correlation would again be equal to zero. Setting the 
fraction on the right equal to zero, clearing of fractions, and 
transposing as above, ra-v = 

We shall now substitute this value for r,/y in the equation 
second above where we said we wished to get lid of it. After 
making this substitution, we have, 


^afa/Tg/y'Tyyf 

What we started out to find was the correlation between the 
variates taken at their true values m terms of the correlation 
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when the values were taken as centered about the means of 
intervals. That is, we want a value for We can easily 
solve for it the equation just given, getting 

f (Formula for oorreoting an r for broad 

r®'#' categories when calculated in terms (211) 

Txi/T yyf of means of intervals) ^ ^ 

The correlation between the variates is, therefore, the correlation 
in terms of means divided by the product of the r’s between meang 
and variates in each of the two arrays. 

But the catch is that, except in cases where we can draw 
upon ready-made tables, wo are not likely to know the coefficient 
of correlation between means and variates within each of the 
distributions. We must meet this difficulty by next getting a 
formula for the r’s between the means and the variates of a 
distribution. 

If we assume rectilinearity of regression between means and 
variates, the value of a variate computed from the mean of its 
interval is, as w'o learned when we studied the simple regression 

equation in deviation form, = r„' — z. But the z' is the one 

that lies on the regression line, and, assuming rectilinearity of 
regression as said above, it is at the mean of its column. There- 
fore z' is the same as x, which is by notation the value of the mean. 
Dividing through therefore by this value, we get r*®' = (<r*/<ra/). 
In a precisely similar manner it can be shown that 




fk 


(Formula for the coefi&cient of correlation between 
means and variates within a distribution) 


( 212 ) 


If now we substitute these values for the r’s in formula (211), 
we get another formula for correcting for broad categories that 
is simpler for many applications. 


r»'v' 


(o’vAi/') ' (ca/ffy) 


(Equivalent formula 
for r corrected for 
broad categories in / 9 «| o \ 
case computed in 
terms of means of 
intervals) 


If we are working with distributions of unit area and unit 
standard deviation, (as we are when we deal with proportions 
in the several intervals and apply x and values froip our tables 
pages 481 to 484) and if we assume normality of distribution as 
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it is assumed in those tables, both the and the <Tyf will be 1, by 
definition. Then our formula will simplify to 




isL = 

No-^ 


(Formula for r corrected for broad 
categories in case of ineasiires 
centered about ineana of intervals 
and a normal distribution of unit 
area and unit standard deviation) 


(213a) 


This does not apply to the correction of r’s computed from 
such correlation tables as wo dealt with in Chap. IV and as we 
employ in most product-moment work, because there the items 
are taken to be centered about the mid-points of the intervals 
(called index values) rather than about the moans of intervals. 
A reasoirably satisfactory correction can be made for this case, 
but not so neatly as for the case of means. 

Let Xi be the deviation of the mid-point score value of an 
interval in the x array, and let x be a score in deviaiion form. 
Let 2 /i and y have similar meanings in the other array; and lot 
c* be the difference between an x and the corresponding index 
value and Cy have a corresponding meaning in the other array. 
Then 


_ 21(a:< -j- Ca;)(yi Cy) _ + SxjCy 4~ S;/i-c» -b XCjfiy 

N <7 (aji+cijO" (v.+c) N ff (*,+c»)0' (Vi+ck) 

Some c*’s wiU be positive and some negative. If there wore 
nearly perfect correlation, not only would the c»’h fall in the 
same interval as their corresponding paired y values but would 
also tend to fall on the same side of the mid-point of the interval 
to which they belonged in the other array; thus there would 
tend to be an excess of like-signed XiCy values. But that would 
happen only in extremely high correlations. Under all other 
conditions they would fall largely at random on either side of 
the mid-point and thus haVe random plus or minus signs; or 
they might even fall into other intervals in the y array from 
the corresponding one in the x array. Hence, over the whole 
distribution the products would tend to sum to zero. The 
same thing would be true of the XiCy products and the CgCy 
products. Hence for an approximation which holds well for 
all except extremely high r’s, the numerator needs no correction. 
The o-’s in the denominator are standard deviations of distribu- 
tions in terms of index values, and their correction calls merely 



FURTHER METHODS OF CORRELATION 


397 


for Sheppard's correction, treated on pages 84 to. 89. 
fore, we have 





(r corrected for broad 
categories in the case 
of index values) 


There- 


(214) 


Thus we can either incorporate the needed correction in 
the original computations by making Sheppard's correction in the 
standard deviations or we can correct an r computed from broad 
categories by dividing it by the product of the two ratios 



where the <r’s are the ones computed in terms of index values. 
It is these ratios which are tabled as the fourth and fifth columns 
in Table XXXIII, page 398. This formula is extremely impor- 
tant, since it fits the situation in which we customarily compute 
coefficients of correlation. It is so easy to make Sheppard’s 
correction (merely subtract one-twelfth before taking the square 
root, or such modifications of this as are explained on page 73) 
that it would be a good practice to make it in all correlations 
computed from correlation tables. Certainly it is imperative 
to make it if the number of intervals is as few as 5 or 6 and better 
to do it with anything less than 12 or 14. 

One more case of interest is the special one where we may 
assume a rectangular distribution. As shown on page 107, the 
standard deviation of the means of a rectangle is -s/ik^ — 1)/12, 
where k is the length of the rectangle, ‘ while the standard 
deviation of the variables in a rectangular distribution (which is 
the same as one in which the niunber of subdivisions is indefinitely 
large) is -s/k^lVZ. Using, then, for the standard deviation of 
the means over the standard deviation of the variates, we have 



(Correlation of variates with cither 
means or index values in a reo- (215) 
tangular distribution) 


* Kelley { StaMsticoi Method, p. 267) gives as the standard deviation of a 
lielk - 1) 

reetan^e ^ — ~ — *• But this is inoorrect, and his table of values of r’s 
on p. 268 (of Statistical Methods) is also incorrect as far as the column for 


But this is inoorrect, and his table of values of r’s 


rectangular distributions is oonoenred. 
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In correcting r for broad categories where rectangular distribu- 
tions are involved, we substitute this value for one or both of 
the r’s between means and variates called for by formula (211). 

If the width of intervals differs for different parts of the diKS- 
tribution, we must actually compute the or of the means or of 
the index values. But, if the intervals are either known to bo 
equal or may be assumed to be equally spaced and if wc assume 
a certain known type of distribution, then the r^s may be tabled 
once for all. Thereafter, knowing the number of categories 
into which the distributions are divided, it is only necessary 
to refer to such a table to obtain the r's required for the denomi- 
nator of the fraction in formula (211). We shall give such table 
below. Because sometimes the number of categories is the same 


Table XXXIII. — Coefficients of Cobbelation between Vabiates 
AND Means ob Index Values 


No, of 
categories 

Between means 
and variates, normal 
distribution 

Between index 
values and variates, 
normal distribution 

Between either 
means or index 
values, rectangular 
distribution 




rx%* 


Txx* 

r^xx* 

2 

.798 

.637 

.816 

.667 

.866 

.760 

3 

.859 

.738 

.859 

.737 

.943 

.889 

4 

.915 

.837 

.916 

.839 

.968 

.938 

5 

,943 

.890 

.943 

.891 

.980 

.960 

6 

.969 

.921 

.960 

.923 

.986 

.972 

7 

.970 

.940 

.970 

.941 

,990 

.980 

8 

.976 

.953 

.977 

.955 

.992 

.984 

9 

,981 

.963 

.982 

.964 

.993 

.987 

10 

.985 

.969 

.985 

.970 

.995 

.990 

11 

.987 

.974 

,988 

.976 

.996 

.992 

12 

.989 

.979 

.990 

.980 

.996 

.993 

13 

.991 

.982 

.991 

.983 

.997 

.994 

14 

.992 

.984 

.992 

.985 

.997 

.995 

15 

.993 

.986 

.994 

.987 

.998 

.996 


in both distributions and sometimes different, we shall give both 
T and r^, the being needed in the former case and the product 
of two different r's in the latter* The for means were com- 
puted by formula (212), using a range of six sigmas along the 
base line. Those for index values were computed by formula 
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(214), and those for rectangular distributions by formula (215). 
The reader will note with interest, and perhaps surprise, the 
extremely close parallelism between the r’s for means and 
variates and those for index values and variates. 

We shall now return to the correction for broad categories 
of the C we computed for the Burgess and Cottrell data. An 
examination of the correlation table on page 415 reveals a very 
peculiar distribution. Certainly it is not a normal distribution, 
and neither is it rectangular. It is somewhat triangular in 
shape. Since we have no ready-made formula for correction in 
the case of triangular distributions, we would not be far amiss by 
viewing it as approximately the same shape as one-half of a 
normal distribution. If the regression between means and 
variates in a normal distribution is rectilinear, as we have been 
assuming, the slope of the regression line will be the same for the 
lower half as for the whole distribution. We shall therefore do 
well enough by using the correction for a normal distribution, 
provided we treat the number of categories as eight rather than 
four. Referring to the table for the r between means and variates 
in case of eight categories, we have 

If we had treated the distribution as rectangular, with four 
divisions, our result would not be very different; we should have 
been required to divide the .25 by .938 and should have obtained 
.266. 

QUANTITATIVE VABIATES, UNEQUALLY SPACED INTERVALS 

The type of situation to which we next wish to apply a correla- 
tion technique is one in which we may plausibly think of the 
variates as quantitative in nature but in which we have insuflBL- 
cient reason to believe the intervals into which the distributions 
are divided are of uniform length. In addition the number of 
categories is likely to be rather small, so that correction for 
broad categories is needed. As a concrete illustration of this 
type of problem we shall use part of an investigation by Fred F. 
Lininger on the relation of milk drinking to various types of 
phyacal and mental growth. The ooridiation table below shows 
on the X axis three categories for amount of milk consumed while 
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on the Y axis are laid off amounts of gain in weight during the 
school year. The study was conducted in the public schools of 
Philadelphia. 


Table XXXIV. — Extent oe Consumption op Milk in Relation to 

Gain in Weight 


Gain in. 
weight, lb. 

No 

milk 

f 

Milk at 
home only 

/ 

Milk at 
home and 
school 

/ 

Total 

/ 

1 

Per- 1 
cent- 
ago 

Location 
of moan 

Over 6 

9 

69 

62 

140 

8.8 

+ 1.815 

4r-6 

64 

242 

227 

533 

33.1 

+0.098 

1-3 

153 

364 

281 

798 

49.6 

-0.474 

0-0.99 

29 

' 48 

25 

102 

6.3 

-1.(537 

Loss 

13 

16 

6 

35 

2.2 

-2.386 

Totals 

Percentage 

Mean 

268 

16.7 

-1.498 

739 

46.0 

-0.280 

601 

37.4 

+1.013 

“l,608 




We cannot consider the distance from the central point of 
"no milk” to “milk at home only” one stop and that from 
"milk at home only” to “milk at home and school” another step 
of the same length. Wo do not know at all the relative lengths 
of these steps. In order to get some quantitative index for tliose 
distances, we must make some assumption about the nature of 
our distributions. It does not seem unreasonable to assume a 
normal distribution of children in respect to the amount of 
milk consumed by them. Since in this distribution wc know the 
proportion of oases in each of the three categories, we can find 
the distance of the mean of each of the sectors from the mean 
of the distribution as a whole by a method discussed under our 
treatment of the normal curve, page 290. If the distance from 
the mean of the sector to the mean of the whole distribution be 
designated as the height of the bounding ordinate at the left 
of the sector by z\, and the height of the bounding ordinate at the 
right of the sector by Zi, then 

Zi 

tc 

area 

In the sector on “milk at home and school” ai *» 0.8789 as 
given in the table, page 481, for a g of .374. Here a* is aero. 
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because this sector extends to the upper end of the distribution. 
Hence 




0.3789 - 0 
.374 


=.1.013 


For the middle sector zi — 0.2502, as shown in the table for a 
q of .167, and z^, = 0.3789 as before. Hence the mean of this 
middle sector lies at a distance from ^ 
the mean of the whole distribution only 4$%) 


xz = 


0.2502 - 0.3789 
.460 


= -0.280 


A/o 
milk 
)&7%. 


Home and 
school 324% 
/ 
r 



Fig. 31. 


In a similar manner the other x 
value, and all the y values arc found. 

Wo now compute the coefficient of correlation in precisely 
the same manner as a Pearson r for any other correlation table. 
The procedure docs not differ at all from that described in 
Chap. IV. As the result we get 


_ Sxy _ 


217.08 


1608(.890)(.923) 


= .164 


But this r stands in considerable need of correction for broad 
categories, especially in respect to the x variable where there 
are only three categories. To make this correction, we need to 
divide the obtained r by the product of the r’s between means 
and variates as indicated in formula (212) — ^for we have been 
working with our data centered about means of intervals rather 
than about index values. We shall forego looking in our table 
of these r values, page 398, because the intervals may not be 
sufficiently equally spaced. According to formula (212): 


r**' = — and = — 

<r»' (Ty' 

We have already computed or, and (r„; they are the standard 
devialaons of the means obtained in connection with our solution 
above. Since we have assumed a normal distribution and are 
working with proportions with the aid of our integral tables, the 
standard deviation of the variates will be 1 in each of the dis- 
tributions — ^for our table upon which we drew for x and z values 
is based on the assumption of unit area and unit standard devia- 
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tion. Therefore 


»'»»' = j = O’® = -890; and r„„< = j = = .923 

Our corrected r then becomes 

_ .164 _ 

(.890) (.923) ■ °° 

Had it not been for the fact that wo wished to illustrate fully 
the principles at stake, wc could have saved several steps, and 
yet secured precisely the same result, by applying directly 
formula (213a) instead of proceeding by way of formulas (211) 
and (212). 

If we had assumed our intervals equal in span and had obtained 
our values from Table XXXIII for the r’s between moans and 
variates, we would have had 

“ ~ (.869) (.943) 

But this closeness of approximation is somewhat accidental; 
unless the intervals are actually spaced equally, wo would not 
always come as near the correct value by using the t.able. 

Exercises 

1. By dividing the students in Table IV into those *‘high^^ in gen<^ral 
intelligence (score 100 or above) and those **low'^ in this function (h(*low 
100), compute a biserial r between intelligence-test standings and gra<lo- 
point averages. Compare this with the Pearson product moment r. Coiu- 
pute the P.E. of the product moment r and compare it with tho P.hl of the 
biserial r, 

2. By dividing both distributions at some convenient point, compute 
tetrachoric r for the same two factors as in Exercise 1, and comparo with tho 
two r’s computed in Exercise 1. Compute the P»E, of this r. 

S. Compute this r from broad categories; fe., group the intelligence scores 
into, say, four intervals and grade-point averages into five, determine r, 
and correct it for broad categories. 

4 . Compute an r for the Burgess and Cottrell data on page 415 by the 
methods described on pages 391 to 393. 

5 . Out of a total population of 475 college seniors, 71 were selected by a 
guess who test as most outstanding in social leadership and another 69 as 
least effective in social leadership. Of the high ones 27 had taken more than 
six credit hours of history and 44 had taken 6 hr, or less, whereas of the low 
ones 14 had taken more than 6 hr* and 65 less. Compute the coefiSioient 
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of correlation between amount of history taken and effectiveness in social 
leadership. Of these same students 26 of the high and 34 of the low had 
taken more than 6 hr. of physical science while 45 of the high and 35 of the 
low had taken less. Compute a similar r between extent of study of physical 
science and leadership. 
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CHAPTER XIV 
CHI SQUARE 
THE NATURE OF 

In recent years a great deal of attention has been given the 
test developed by Pearson.^ The situations to which this test 
may be applied are of the type where we have both theoretical 
and observed measures and wish to know whether differences 
between these measures can reasonably be regarded as chance 
variations. Provided the true variance within each class can be 
known or estimated, the technique can be applied to a number 
of different types of problem to measure the probability of getting 
a given divergence in a sample from corresponding theoretical 
values in the parent population. One use is the testing of fit 
of a normal curve to the sample population; and it can be applied 
to all forms of curve fitting where we can know the distribution 
of the classes to the means of which we are attempting to fit 
the curve. Another important application is to test for associa* 
tion between variates in a contingency table. 

In general, if x is a value in the form of a deviation from the 
mean of the whole population of its class and, in the infinite 
population, the variates are normally distributed, then x^ is 
defined by the relation 



where ofj is the true population variance of the class. The x 
may be a single measure, or it may be the mean of a sample, 
or a proportion, or any other statistic normally distributed. 
It is evident that x^ is related to the variance of the set of n 
statistics; for, if the deviations are taken from the population 
mean of each class and are summed through the set, » ns®. 

^ Pearson, Karij, the Criterion that a Given System of Deviations 
. . . Can Be Reasonably Supposed to Have Arisen from Random Sampling/’ 
Phil. Mag. {London)^ Vol. 60, pp, 157-175 (1900). 
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Hence, if the or| is the same for all the classes of which is 
made up, 

„ ns^ 

X == == 

(Tj ai 

In this chapter our interest is in the distribution of x^ from 
samples, cl will always be the same for a given population. 
But if the null hypothesis is assumed (that each class is a random 
sample from the same homogeneous population), is an unbiased 
estimate of or^. Therefore, the ratio $^/cl will sometimes be less 
than 1 and sometimes greater; as the sample is increased in size, 
will approach and x^ will approach n. For certain purposes 
which will appear later, wc need to know the shape of the x 
distribution and its area between certain ordinates. It may be 
said at once that this distribution is not that of the normal curve, 
except in one special case. 

Suppose, now we consider our re’s one at a time. Then each x^ 
will be merely x^/cl. The probability of getting a x® of any 
particular value will be the same as the probability of getting 
an x^/cl of that same value. If we write zl to denote this value 
of x^/clj the probability that a value Zi will lie within an elemental 
range dzi would be merely 


The probability of getting a x os great as, or greater than, a given 
value would be the integral of the (normal) distribution function, 
vie., 


P = 



1 

•v/25r 


n* 

e ^dzi 


the value of which can be found in the normal probability tables. 

Let us now deal with the probability of getting two given 
independent values of x simultaneously. That probability 
is the product of the two probabilities of getting them separately. 
Hence the probability that these two variates will occur con- 
jointly within the same cell (elemental area) deidzz becomes 
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and the probability of getting simultaneously, in an infinite 
supply of samples, values as great as, or greater than, these 
two would be 


U) 


= r* f’’ (-4=Y 

Jzi Jzn 


Vvw 


If we write x® = 2? + and concern ourselves with the prob- 
lem of calculating this probability, wc ai'e confronted with the 
fact that the value of x’* may be the same although zi and 2 a 

may vary from sample to sample. 
Xd Xd 0 We have here the equation of a circle, 
center at the origin, with a radius 
equal to Xj so that the elemental area 
representing the joint probability 
may be in any position on an ele- 
mental circular region of x as a 
radius. In order to state this fact 
more exactly and to evaluate the 
double integral, it is conv(iniont to 



Fio. 32. 


resort to polar coordinates (Fig. 32). 
The elemental area dzidz^ becomes^ 


in polar coordinates 


X dx dd. Substituting 
above, we have 


for 


+ 2i 


and X dx d& for dzidz» 


df 


-(^y 


«~^*’x dx d9 


If we denote by df the total probability of the occurrence of 
X within the circular region, we must integrate the above expres- 
sion with respect to 9 from 0 to 2r, Integrating with respect to 


9, noting that 


(,v^^ 


xe-i**dx remains constant. 


or, 

(J5) = (\^) 

' See Khnnhy, J. F., Mathematica of StaUatiot, Part II, p. 87, for a simple 
statement of the reason for this. 
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The probability of obtaining a value of x as great as or greater 
than a given xi would be expressed by 

J '* «> 

xe ^dx 


This last integral is of the form e^dv (see page 24) and may be 
integrated directly. Performing this integration, we have 


or, 

( 0 ) 




JX, 


p = 


_£>? 
e 2 


For a given value of x obtained from two independent values of x, 
we could calculate P from this formula. Thus if xi = Ij we 
would obtain, upon substituting in formula (C), 


P = 



1 ^ 1 
Ve vTtIS 


= .6065 


This tells us that the chances are slightly more than 60 in 100 
that we would obtain at random a value of x as great as, or 
greater than, 1 when the value of x® is made up of the sum of the 
squares of two independent variates. 

If we are concerned with the probability of the simultaneous 
occurrence of three independent values of x, we would have a 
triple integral corrcspon^ng to (.4); or for n values, we would 
have an n^fold integral. 

Formula (P) expresses the x distribution function in the case 
of two independent variates — ^the two independent quantities, 
distributed normally about zero, that make up x^- It will be 
noticed that the exponent of x in this same formula is 1 — one 
less than the number of independent variates. If we were to 
go through a similar process for three independent variates zi, zt, 
zs, we would arrive at the formula 

df — kx'‘6~^*dx 


in which Jfc is a constant, and the exponent of the x factor is 2, 
In this situation x may be interpreted as the radius of a sphere, 
and the elemental region as a spherical shell of thickness dx* 
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When the number of independent variates exceeds three, it 
becomes impossible to visualize the meaning of the probability 
of X within an elemental region, and we say that we are dealing 
with the geometry of hyperspace. The mathematics, although 
more complicated, is carried out in a manner analogous to that 
which we have already developed above, and we arc able to 
obtain the general formula for the distribution of x- When x® 
is defined by the equation 

= zl + 4 + A + • ' -4 

the element for the distribution of x becomes 

(D) df = fcx"“‘e ^dx 

in which & is a constant determined mathematically to be 


1 



Notice again that the exponent of x is ~ 1) — oil® loss than 
the number of independent variates that went to make up the 
quantity x®. Formula (D) is the x distribution equation, cor- 
responding in concept to the normal probability equation. One 
difference that should be pointed out is that the x equation is 
a function of n as well as of X) whereas the normal equation is a 
function of x alone. This is because the normal probability 
function is a special form of the x function resulting when « « 1, 
as may be seen by putting n =» 1 in formula (D). 

Suppose, now, in a two-variable problem our operation were 
so restricted that (a:i -f- * 2 ) would need to sum to a fixed amount. 
Then when we had the probability of getting either or xs, 
that of getting the remaining one would be exactly the same. 
There would be only one degree of freedom instead of two. If 
there were n values, but so limited that they had to sum to a fixed 
amovmt, then the probability of getting a certain value for the 
set of n would be exactly the same as the probability of getting 
the appropriate value for the (n — 1) independent ones. There 
would be, (n — 1) degrees of freedom from which the proba- 
bility would be determined. Thus, for every restriction that 
brings it about that a remaining term is determined when the 
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others are known, the number of degrees of freedom is reduced 
by 1. So the multiplicity of the integral is not n, the total 
number of terms, but (n - o) where a is the number determined 
when the others are given. 

Thus in principle it would be simple enough to determine what 
is the probability of getting a x value as great as or greater than a 
given value; we would need only to integrate the product normal 
probability function as many times successively as we have 
degrees of freedom from the several indicated limits to infinity. 
But in practice this would be an impossibly arduous task and 
would be wholly impractical as a procedure. By resorting to 
generalized polar coordinates the evaluation becomes a perfectly 
straightforward task and may be carried out by integrating 
successively by parts, care being taken to consider separately the 
cases when n is even and when n is odd. Since the task is long 
and tedious we shall leave it to the ambitious student as an exer- 
cise and simply write down the reeulting formulas. 

When n is even, the expression for the probability of obtaining 
by random sampling a value of x equal to or exceeding a given 
value is found to be 


■*'[(n-^2)/2]l(5^*) * ] 

When n is odd, 


P = 



5 ^ /o ^2^ r 1 1 

^dx + ^^e 2 |^x + 5X* + ^x'+ • 


■ 3-6 •••(»- 2)^ J 


(217) 


As soon as X is known either Eq. (216) or (217) can be evaluated 
after substitution and the value of P discovered. Even this is 
too complicated to use in practice, so Elderton, working with 
Pearson, tabled its values. Since the distribution is different 
for different n’s, the values are given not only for different x®’s 
but also for different n’s. We give Elderton’s table on pages 498 
to 500. Later Fisher also tabled the x® values in a different 
form; and still later Kelley and others also did so. 
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TKE COMPUTATION AND USE OF x’ 


Now that we have given the x distribution and have shown 
how the formulas for P are obtained, we proceed to show how the 
value of X* is found in practice and how the x“ test may be 
applied. We saw that the probability of obtaining together 
values of Zi and Za witliin the cell dzidza is expressed by the 
.2 

quantity ( — when the two variates are 


(v^) 


assumed to be distributed normally about zero and are uncorre- 
lated. In the more general case where zi and za may be corre- 
lated, the product function would be, as shown on page 368, the 
following: 


ir 1 

dz = zoe~^Li-n.»w Jdxidxa 


For the generalized case (n largo and correlation present) 
Pearson gives the formula 

. - (218) 

in which Zo is a constant and the expression in parentheses involves 
the summation of terms containing correlation determinants and 
the n variates and standard deviations, the first term to be 
summed for all values of p from 1 to n, and the scciond for all 
pairs of values of p and g in which p Is less than g. l^earson 
defines the quantity within parentheses to be x“ and proceseds to 
show in his mathematical development that for the type of 
application most frequently made of x^, this complicated quantity 
can be expressed in terms of weighted squared deviations between 
theoretical and observed frequencies. The proof is so compli- 
cated that we do not deem it advisable to include it here. The 
formula for x“ in terms of theoretical and observed frequencies is 


X* 


2 {fo-SiY 
ft 


(Chi square for goodness of 
fit of observed to thao- (219) 
retical frequencies) 


in which /„ and ft are the observed and theoretical frequencies, 
respectively, in each group, and the summation extends over all 
groups. 

In practice we have only to compute x“ from formula (219), to 
make certain of the number of independent varieties (degrees of 
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freedom) that contributed to its value, and to determine from 
tables the probability of getting a value as large or larger on the 
basis of random sampling. Let us now consider a dice-throwing 
experiment in order to make more concrete the meaning of P by 
using a very simple illustration. 

The authors threw 12 dice in a group 14 times and recorded 
the number of aces appearing in each throwing. Assuming the 
dice to bo balanced perfectly, we should expect theoretically two 
aces to appear at each throwing; but, of course, this perfect 
record was not obtained because of the influence of chance or 
other factors. There were differences between observed fre- 
quencies and those to be expected theoretically; and the question 
arose as to whether those differences were so great as to lead us 
to believe that the dice were biased. The actual number of 
aces appearing among the 12 dice at each throwing (/o), the 
theoretical number expected (/t), the deviations between observed 
and theoretical frequencies (/<, — /<), these deviations squared 
(/» ~ /t)®) and the weighted squared deviations (/<> — /<)“//* are 
shown in Table XXXV. 


Table XXXV. — Numbeii or Aces Appeaeing among 12 Dice in 14 

Theowings 


No, of aces 
appearing at 
each throw 

Cfo) 

Theoretical 
No. of aces 
expected at 
each throw 
(Si) 

Deviations 
between theo- 
retical and 
observed 
(fo-fi) 

Deviations 

squared 

(So 

Squared devia- 
tions weighted 
(So -ft)^ 

St 

1 

2 

-1 

1 

i 

3 

2 

1 

1 

i 

2 

2 

0 

0 

0 

a 

2 

1 

1 


1 

2 

-1 

1 

i 

4 

2 

2 

4 

2 

2 

2 

0 

0 

0 

4 

2 

2 

4 

2 

1 

2 

-1 

1 

} 

0 

2 

-2 

4 

2 

3 

2 

1 

1 

i 

2 

2 

0 

0 

0 

a 

2 

1 

1 

i 

1 

2 


1 

i 

so 

28 

2 


X* - 10 
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The value of is seen to be 10, made up from the 14 independ- 
ent variates or deviations. Entering the tables with a x' — 10 
and n = 14 (14 is the number of independent variates or degrees 
of freedom), we find that P = .762. This means that wc should 
expect to find a value of x“ equal to or greater than 10 in more 
than 76 out of 100 cases on the basis of chance, and this probabil- 
ity is so large that we do not have reason to believe that the dice 
were biased. 

Degrees of Freedom. — ^At this point it might be well to make 
further mention of the meaning of degrees of freedom or number of 
independent varieties. In the dice-throwing experiment the num- 
ber of aces appearing in any of the 14 groups was independent 
of the frequency in any of the other groups. Hence wo must 
take n = 14 when entering the tables to find P. In the examples 
that are to follow, we shall see that the number of independent 
variates or degrees of freedom is not necessarily the same as the 
number of groups used in the computation of x®- If) for exam- 
ple, we had ten groupings of deviations between observed and 
theoretical frequencies and the total number of frequencies was 
the same in each sample, there would be only nine independent 
variates or degrees of freedom since the tenth group contribution 
could be found by subtracting the total of nine groups from the 
grand total. 

How many degrees of freedom obtain in a given application 
of X® depends upon what sort of universe of samples one has in 
mind. If, in a contingency table, one is asking his question 
about the sampling fluctuation in that set of samples in which 
the marginal totals remain the same sample after sample, there 
are (fc — l)(r — 1) degrees of freedom, where k is the number of 
columns and r is the number of rows, because the necessity of 
constant totals for each row and for each column restricts the 
fluctuation in each column to {k — 1) cells and in each row to 
(r — 1) cells. It was upon this interpretation that Fisher 
fastened in his epoch-making article.^ It was only that limita- 
tion which made exact mathematical treatment possible, since 
Pearson’s original development hinged upon known theoretical 
values, which could only be afforded in a sampling scheme if the 
marginal totals remained the same for the whole supply of 

* Fishub, R. a., “On the Interpretation of x* from Contingency Tables,” 
J. Royal StaiisHcal Society, Vol. 86, pp. 87-94 (1922). 
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samples and hence was the same as that of the population 
sampled. But one may, and in most practical research would, 
wish to ask his question about the sampling fluctuation in all 
random samples of the same N, not only in that small portion 
of samples in which the marginal totals remain constant. In 
our illustration of Table XXXVII, for example, the normal 
expectation is that neither the relative numbers taking graduate 
work, college, etc., nor the numbers in the various categories of 
marriage adjustment would remain the same in successive sam- 
ples, but that these marginal totals would fluctuate from sample 
to sample as well avS the frequencies in the several cells, the total 
population of the whole sample alone being fixed. Here it 
would be only the nth cell that could be filled in from a priori 
knowledge, and the number of degrees of freedom would be 
(n' — 1) instead of (fc — l)(r — 1). In a relatively recent 
article Karl Pearson^ has showm very clearly and convincingly 
that the number of degrees of freedom for this interpretation is 
(n' — 1), even though the theoretical values are estimated from 
the sample. He presents conclusive experimental evidence 
that the thus obtained have very closely the same mean 
and very nearly the same standard deviation as the x®^s obtained 
from known theoretical values and that the correlation between 
x'* and x^ ill a number of trials is very high — ^from ,93 to .99. 
Thus the number of degrees of freedom must depend upon one^s 
meaning: if he is talking about the general case in which the 
samples may vary in every respect except N, the number of 
degrees of freedom is (n' — 1), where N is the total population 
and n' is the total number of cells; if he is talking about the 
special case in which the marginal totals are to remain constant 
through all the samples, the number of degrees of freedom is 
(k — l)(r — 1). In most statistical work this distinction has 
been ignored; workers have followed for all purposes Fisher^s 
lead in using (fc — l)(r — 1) indiscriminatingly. Since that is 
now the established custom, we shall follow it here in our illustra- 
tions in order to avoid confusion. But careful workers should 
make and apply the indicated distinction. In the article referred 
to, Pearson shows that the same principle applies in fitting an 
empirical distribution to the normal curve. If one fits a curve 

^ Pbjabson, Kael, ^^Experimental Discussion of the Oc®, p) Test for Good- 
ness of Fit/' Bumetrika^ VoL 24, pp. 351-381 (1232). 
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by using the mean and the standard deviation as well as the N, 
the number of degrees of freedom is (n' — 3) if ho is talking 
about a succession of samples of N, all of which have the same 
mean and the same standard deviation as the initial one. If he 
is not imposing that restriction and instead is talking about the 
general case where only N remains constant, the number of 
degrees of freedom is (n' — 1) regardless of the fact that two 
additional statistics of the sample were employed in the fitting. 
This latter procedure is the one now most frequently followed in 
American practice, though a few workers have used the former. 

EXAMPLES OF THE x* TEST APPLIED TO CONTINGENCY TABLES 
Table XXXVI gives by nationalities the number of foreign-born 
males twenty-one years of age or over who have been natural- 
ized in a certain district, together with the theoretical number 
to be expected in terms of percentages of the total number 
naturalized. 


Table XXXVI. — Number op Pobeion-born Males Twenty-one Ybaiss 
OP Aoe or Over, Naturalized 



Italians 

E\ 2 ssians 

Polish 

Others 

Total 

Number naturalized 

161 

^^9 


32 

295 

Theoretical number 

(183) 



(2S) 

(29f))_ 

Total number in district. . . . 

366 

116 

52 j 


' '688 " 


The numbers in parentheses were obtained by taking per- 
centages of the total number naturalized for each nationality 
group. (HI) (295) gives 183, the number of Italians expected 
to be naturalized in the district on the basis of nationality 
representation. (H|)(295) gives 68, the number expected for 
the Russian group. In a similar fashion the other theoretical 
frequencies in parentheses wore obtained. 

In order to compute the value of x*, we must use the formula 
X® = 2(/, — /<)V/i- The data for this purpose are as follows: 


Cf. - ft ) 

-22 

24 

-6 

4 

X * 

( f »- ft )^ 

(f. - /<)* 

484 

676 

86 

16 


ft 

2.64 

9.93 

1.38 

.67 

14.62 


n -3 
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We have, therefore, that = 14.52. Since the frequency 
for the group marked Others can be obtained by subtracting 
the total for the three other nationality groups, we have here 
only three independent variates or degrees of freedom. Entering 
the chi-square probability tables with n - Z and = 14.52, we 
obtain by interpolation between 14 and 15, P = .002. This 
probability is too small to conclude that the differences among 
the nationality groups in the proportion naturalized can be 
explained as having arisen from errors of random sampling. 
We conclude, therefore, that there are other factors operating 
to account for the differences. 

Another example might be to test whether there is association 
between marriage adjustment and the amount of education 
possessed by the individual. Table XXXVII displays the 
observed frequencies of marriage-adjustment scores for 513 
husbands according to education.* 


Table XXXVII. — Distbibotion of Marriage- adjustment Scores at 
Different Educational Levels* 


Education 

Marriage-adjustment score in relation 
to husbands' education 

Totals 

Very low 

Low 

High 

Very high 

Graduate work 

4(11.9) 

9(17.8) 

38 (29.8) 

64(45.5) 

105 

College 


31(34.6) 

56 (67.9) 

99 (89.4) 

205 

High school 

23(17.2) 

37(25.8) 

41(42.9) 

51 (66.1) 

152 

Grades only * 

11 ( 5.8) 

10 ( 8.6) 

11 (14.4) 


51 

Totals 

58 

87 

145 


513 


1 Adapted from Burgess and Cottrell* 


Of the 613 husbands tested 106 had engaged in graduate work; 
and of these 4 received “very low” marriage-adjustment scores, 
9 “low,” etc. The theoretical number to be expected in each 
cell is given in parentheses. For example, (11.9) is the theoretical 
frequency of “very low” scores for husbands having had graduate 
work. The theoretical frequencies for each cell are obtained by 
first computing the probabiUty for each cell and then multipljdng 
by the total number. Since there are 106 scores in the first row, 

I Burgess, Ernest W., and Cottrell, Leonard S., Jr., “The Prediction 
of Adjastment in Am». SoeM, Bee., October, IdSd, p. 7^. 
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we take as the probability of obtaining a score in that row 
The probability that a score will lie in the first column is taken 
as The probability that a score will lie in the first row 

and the first column — ^thc upper left-hand cell — will then be the 
product of these probabilities or (Ml-) (-Mr)- To obtain the 
number of frequencies to be expected in that cell, we must 
multiply the probability by the total number 513. We have 
(Ml) (t^) (513) = (11.9). The other theoretical frequencies 
in parentheses are found in a similar manner. 

Let us now determine for the contingency table dealing with 
the relationship of marriage-adjustment scores and husbands’ 
education. Here there are four columns (Very low, Low, High, 
and Very high) and four rows (Graduate work, College, High 
school, and Grades only). Since from the marginal totals we are 
able to compute the fourth row or column, knowing the three 
others, we have (4 — 1)(4 — 1) = (3) (3) = 9 degrees of freedom, 
if we are making the customary interpretation that the marginal 
totals remain fixed. 

The theoretical frequencies for each cell have already been 
calculated and are found in parentheses in Table XXXVII. 
We now display in Table XXXVIII the deviations betweem 
theoretical and actual frequencies and the weighted squared 
deviations for each cell. 


Table XXXVIII. — Deviations between Thbokbtical and Ob.servbd 
Frequencies |/. — /<| and Weighted Squared Deviations 

ilt , „ /*). .. poH the Contingency Table XXXVII 


Eclucatiou 

Marriage-adjxistment scores in relation to 
husbands' education 

Totals 

Very low 

Low 

High 

Very high 

Graduate work. 

College 

High school 

Grades only 

Totals 

7.9( 5.3) 

3.1 ( 0.4) 
6.8( 1.9) 

6.2 4.0) 

8.8 (4.3) 
3.6 (0.3) 
11.2(4.8) 
1.4 (0.2) 

8.2 (2.6) 
2. 9(0.1) 
1.9 (0.1) 
3.4 (0.8) 

8.6( 1.7) 
9.6 ( 1.0) 
16.1 ( 4.3) 
3.2( 4.6) 

(13.8) 

( 1.8) 
(11.1) 
(10.2) 

(12.2) 

(0.6) 

(3.5) 

(11.6) 

(86.9) 


The numbers given in parentheses are the squared deviations 
divided by the theoretical frequencies for the cells. In the 
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upper left-hand cell, for example, we have 

(/o - /.) = 4 - 11.9 = -7.9 

the deviation, and (/<, = (- 7 . 9 ) 711.9 = (5.3), the 
weighted squared deviation. The other numbers in parentheses 
are computed in the same way. The number (36.9) appearing 
in the lower right-hand comer of the table is the sum of all the 
squared deviations weighted for the theoretical frequencies and 
is, therefore, our value of x*- We enter the tables with x® = 36.9 
and n = 9 and find that P = .000142. This value of P is 
so small that we cannot attribute the differences to errors in 
sampling, but must believe there is an association between 
marriage adjustment and husbands’ education. 

Let us now apply the x* test to the normal-curve graduation 
data for the 149 sophomore scores on the Carnegie Foundation 
Tests, 1930, found in Table XXV. The differences between 
the theoretical curve and the histogram shown in Fig. 21 reveal 
that in some intervals the curve calls for greater frequency and 
in other intervals less frequency than actually exists in our data. 
The question naturally arises as to what extent the superimposed 
curve truly represents the data in question. The test works 
very well in testing goodness of fit; for, if the probability is so large 
that we may obtain on the basis of chance a value of x“ as large 
as, or larger than, the one in hand, we may reasonably conclude 
that the fit is a good one. On the other hand, if the probability 
is small, we are unable to account for the difference on the basis 
of chance fluctuation and must conclude that the curve is not 
representative of our data. 

The chi-square technique is not sound unless the numbers in 
the cells are reasonably large.* For tins reason it is customarily 
advised that cells with small frequencies be combined. Since 
the upper 3 and the lower 3 intervals of Table XXIV contain 
ten or fewer theoretical frequencies, we have lumped these 
extreme tails into 2 intervals, making 8 intervals for our data 
instead of 12. The theoretical frequencies of the intervals are 
determined in terms of the normal-curve function and the iV 
of this sample, as shown on page 418. The parameters in terms 
of which this sample is fitted to the normal curve axe N — 149, 
mean = 216.4, and «r == 60.9. 

* See EmnniT, op, cit., p. 170, for a simple statement of tlie reason for this. 
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Table XXXIX. — The Computation op x’ roa the Nobmal-cubve 
Graduation op Table XXIV 


Interval 

Frequencies 



(/« - /.)* 

fo 

fi 

/< 

279 5-339.5 

16 

14 

2 

4 

.29 

259.5-279.5 

12 

14 

-2 

4 

,29 

239.5-259.5 

19 

19 

0 

0 

.00 

219.5-239.6 

26 

23 

3 

9 

.39 

199 5-219.5 

22 

24 

-2 

4 

.17 

179.5-199.6 

18 

20 

-2 

4 

.20 

159.5-179.5 

14 

16 

-2 

4 

.25 

99.5-159.5 

22 

19 

3 

9 

.47 

Totals 

149 

1 

149 

0.00 

1 

X* « 2.06 


The X® is 2.06. We next wish to know the probability that 
so large a x* could arise from this type of situation merely on 
the basis of chance fluctuation. With what number of degrees 
of freedom shall we enter the table? The same dual interpreta- 
tion is possible here as in the case of contingency tables, discussed 
on page 412. If we mean how frequently would chance fluctua- 
tion give rise to a x® as large as 2.06 in a sample of 149 scores when 
only the size of the sample remains constant, the number of 
degrees of freedom is (n' — 1) = (8 — 1) = 7. Entering Table 
XL VIII with n = 7 and interpolating between x* = 2 and 
X® = 3, we get P — .96. If we mean to ask about the P for that 
universe of samples which continues to have, sample after sample, 
the same mean and the same cr as the initial one as well as the 
same N, the degrees of freedom are (n' — 3) =» (8 — 3) » 5. 
For this the P is .84. Both of these indicate a very good fit. 
The former means that, even if the function were distributed 
perfectly normally in the whole population, aa great departure 
as we obtained or greater would occur in samples 95 times in 100. 
The latter means that, even in that more restricted sampling 
in which the mean and the standard deviation as well as the size 
of the sample remain constant, so great a discrepancy would occur 
by chance 84 times in 100. We may, therefore, feel no hesitancy 
in believing that the distribution would be normal e.xcept for 
chance fluctuation. In fact, the fit is unnaturally good; the 
most likdiy P for a true fit is about .60, 
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VALUES OUTSIDE THE RANGE OF OUR TABLE 

Our tabic, following Elderton, extends from n = 2 to n = 29. 
For « = 1, X is distributed as half of a normal distribution, as 
sho\ra on the opening pages of this chapter. So, for n = 1, look 
in our normal distribution table, pages 485 to 487, under x = 
and obtain the percentage in the tail of the distribution, then 
multiply this by 2. For example, x* = 4; x = 2; in the table 
for = 2, <? = (.50 - .4772) = .0228; 

P = (2) (.0228) = .0456 

This is the P corresponding to x* = 4. 

For applications \vherc n exceeds 29, Fisher has proposed that 
w e assume that maj’- be treated as a normal d eviate a bout 

■\/2n — 1 as mean.i Example; x® = 50; n = 41; \/82 — 1 = 9. 
=10. i = 10 — 9 = 1. Looking in our table for 

i=l 

we find that P = (.60 - .3413) = .1587. 


RELATIONS AMONG x\ F, AND a 

Recall, from our opening paragraphs, that 


(E) 






i.e., the denominator must contain the true population variance. 
But sometimes this cannot be known and must be estimated. 
Then the probability of a given value for the fraction as a whole 
is a resultant of the probabilities of getting independently the two 
sample values of numerator and denominator instead of that of 
the numerator alone. The fact that now both numerator and 
denominator are sample estimates changes the shape of the 
distribution from that of a Pearson type IH curve to a type VI 
curve,® For the ratio of the two sample variances Fisher uses 


‘ By differentiating Eq. (D) with respect to Xi equating the deri vative to 
zero, and solving, we find the modal value of A/Sj? to be •\/2n — 2. 
Because the distribution is skew, the modal value would differ somewhat 
from the mean value. 

* Fishj®, R. A., "The Goodness of Fit of Regression Formulae, and the 
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e®' and Snedecor uses F, so that 

(F) = I 

The distribution of 2 or of F is found by using the product prob- 
ability principle. From Eq. (£'), si == xl^^/n 2 . 

Then F = (n 2 Xi)/(^ixl), or x? = (^i/^ 2 )x 2 ^- Now using the 
general x^ distribution, wc are able to write down the simultane- 
ous distribution of x? and xl- After writing down i.his com- 
plicated product function, we substitute for xi, the value 
(^i/^ 2 )xl^\ integrate for the whole range, and finally obtain the 
distribution 


df 


, [(ni 4“ ^2 


ni — 2 ^ 2 


3m} 3.3. 




e3i^dz 


I 


n;+na 
{uie^ + nt) ^ 


The probability integral for the distribution of « or of F yields 
very complicated expressions which must be evaluated for 
different values of ni and n 2 . Tables for z for the 6 per cent and 
the 1 per cent points of the distribution were made by Fisher for 
ni = 1, 2, 3, 4, 5, 6, 8, 12, 24, and « ; and for nj values from 1 
to 30, together with 60 and «. Snedecor made corresponding 
tables for the distribution of F. 


STUDENT’S t 
Student’s t is defined by the relation 


where » is a deviation of a statistic from the true value in any 
application in which the a:’s may be assumed to be normally 
distributed and s, is an estimate of the standard deviation of 
the ®’s made from the sample. But, from (JS), 


Sat — 



whence t 


X x-s/n 1 

xff/Vn ® X 


Since and s/n are constants, the distribution of i is found by 
first writing down the simultaneous distribution for x (normal) 

Distribution of Regression Coefficients,” J. Roy. Statistical Soc., Vol. 86 

p. 601 (1922). 
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and for % (as defined above), as is done in tbe case of the z 
distribution, substituting for x in terms of t, and performing the 
proper integration. The distribution turns out to be 



The definition of t in Eq. (G) is more general than that with 
which Student himself dealt. He dealt with only the case of the 
mean divided by an estimate of its standard error. But Eq. (G) 
assumes that the distribution is general for the whole class of 
statistics in which deviations from the true value make a normal 
distribution, and Fisher has proved that this is true. The dis- 
tribution of t is applicable “to all cases which can be reduced to 
a comparison of the deviation of a normal variate with an 
independently distributed estimate of its standard deviation, 
derived from the sums of squares of homogeneous normal devia- 
tions, either from the true mean of the distribution or from the 
means of samples.”^ We give tables for the probability integral 
of t on pages 173 and 488. 


IN TERMS OF F 

In Chap. XI we made use of the distribution of when the true 
is zero and cited a table we had constructed for this purpose. 
We shall here derive the formula upon which that table was built. 
On page 333 we showed that in the sample 


vj = + ffs. 

Substituting population estimates for sample values 


N - 1 
N 


o2 


N -k 
N 


si + 


k — 1 
kn 


s 


2 

m 


where sj}, is the estimate of the population variance from the 
means of classes. Dividing through by s|(iV — l)/iV, and remem- 
bering that kn = N, 


* Matron, Vol. 6, p. 94. 


W - ^ , k - 1 s®. 

N - 1^ N -l' si 



422 


STATISTICAL PROCKLURTOS 


But in the case where all variances arc assumed to be estimates 
of the same homogeneous population variance (f.c., where the 
F. Therefore 


null hypothesis is being tested), 

N -k , k-1 


(T) 


S' 

si 


N N -1 


■F 


Now, by definition, e® = 1 — sl/s^. Hence, by algebraic manip- 
ulation and then substitution in (7), 


— 1 1 


iV — ^ /c — 1 

jv _ T + 


Multiply through by (1 - €=)(JV — 1), transpose, and solve for 


{N ~ 1) ^ {N -k) - (N - ky + (,k- 1)F - (& - 
(JV - ky + (k- 1)F«* = (7c - 1)F - (_N -1) + (N -k) 

- (ft - 1)F - (ft ~ 1) 

(fc - i)j. - - 1) 

{k - 1)F +iN -k) 


.2 = 


We constructed our table of the distribution of e® by sub- 
stituting for the values of F at the 1 per cent and the 6 per 
cent positions at the various JV and k levels. This is Table 
XL VII, pages 494 to 497. 


A RECENT APPROACH TO SAMPLING DISTRIBUTIONS 

The whole matter of sampling distributions will probably bo 
given reorientation in terms of some recent devclopmcmts which 
bring all the issues we discussed in this chapter together into 
very simple perspective. Huntington^ has recently shown how 
to write in general terms the distribution of the quotient between 
two independent statistics when we know the sampling distribu- 
tion of each of them. Suppose a: is a variable distributed in 

accordance with a probability law fi{x)dz =* 1, and y is a 
variable distributed in accordance with the probability law 
/8(y)dy = 1, as and y being independently distributed, Then 

^ ‘Htotington, E. V., "Frequency Distributione of Product and Qao- 
tient," Am. Mathematical StaMstice, Vol. 10, pp. 19B-198 (1989), 
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the quotient w = xfy will be distributed according to the law 
00 

Q{w)dw = 1, where 

= Jq"" fi(m)My)y dy 

This integral may be evaluated as soon as we are able to 
insert the values from the distributions of the separate statistics, 
X and y. There are three cases as follows: 

1. Where x has a gamma distribution and y is a constant. 
This is developed by Karl Pearson in 1900. 

2. Where x has a normal distribution and y has a gamma dis- 
tribution.. This is tj developed by Student in 1908 but previously 
discovered by at least two other mathematicians. 

3. Where both x and y have gamma distributions. This is 
Fisher^s z or Snedecor's F, developed by R. A. Fisher about 1924. 

We know the distributions of x and y for all these cases, pro- 
vided the samples are independent random ones drawn from 
variables normally distributed in the parent population. His- 
torically the sampling distributions of x and y were derived 
by use of hyperspace geometry, by the technique of generalized 
polar coordinates, and the presence of certain expressions like 
“degrees of freedom^' comes over from this geometric approach. 
But Dunham Jackson^ has recently shown how to derive these 
equations by purely analytic (algebraic) methods. This recent 
work by analytic methods makes possible simplification and 
unification of the concepts and processes involved in the topics 
of this chapter in a manner that is in marked contrast with the 
intricacies and the dif&culties involved in their historical develop- 
ment, But it is beyond the scope of this volume to follow through 
these derivations. 

Exercises 

1. Put together into a single contingency table the data given on page 83 
regarding conformity by taxi drivers and chauffeurs, and apply the x® 
technique to determine whether or not these differ significantly. Since x® 
cannot work with percentages, take each poptilation to he 1,000, and reduce 
entries to numbers. 

2. For the exercises in this chapter where the number of degrees of freedom 
was taken as (ib ^ l)(r - 1) use instead (?i' - 1) and compare. Compare 

^ Jacxson, Dunham, “ Mathematical Principles in the Theory of Small 
Samples,'’ Amer, Mathematiccd MorMy, Vol. 42, pp. 344-364 (1936). 
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for plausibility the two iuterprotations appropriate to the differeut degrees 
of freedom. 

3. In the Journal of Educational Psychology, VoL 30, page 119, Wood and 
Davis give the following distributions of scores in acquisition and retention 
for a certain unit of work. The first row gives the score values and the last 
two rows give the frequencies for these scores in acquisition and in retention. 


Score 

7 

9 

ll’ 

13 

15 

17 

19 

21 

23 

25 

1 


Frequency acquisition 

4 

3 

4 

11 

8 

i 

11 

i 

7 

10 

H 


Frequency retention 

3 

3 

11 

16 
! 

10 

□ 

19 

! 

12 

9 

7 

1 

3 

B 



a. Wood and Davis apply the chi-square technique to this in order to 
determine whether there is any true difference betwoem retention and 
acquisition, taking the obtained acquisition frequencies as the expected** 
{theoretical) ones and the retention f requencies as the obtained ones, Pox'fonn 
this operation. What would need to be assumed about the constancy of the 
acquisition scores in successive samples when that method is used? How 
reasonable is that assumption? 

b. Work the problem to find x* by the regular method of a contingency 
table. What are now the assumptions? How reasonable are they? 

References for Ftirther Reading 

Demwg, W. E.; **The Chi-square Test and Curve Fitting,'' J, Amer. Statis- 
tical Soc., Vol. 29, pp. 372-382 (1934). 

Fishbb, R, a.: “On the Interpretation of Chi-square from Contingency 
Tables,” J, Roy. Statistical Soc., Vol. 85, pp. 87-94 (1922), 

: “The Goodness of Fit of Regression Formulae,” /, Hoy. Statistical 

Soc., Vol. 85, pp. 597-612 (1922). 

: “The Mathematical Distribution Used in Common T'ests of Sig- 
nificance,” Econometrika, Vol. 3, pp, 363-367 (1935), 

Kbnnbt, John F.: Mathematics of Statistics^ D. Van Nostrand Company, 
Inc., 1939, Part II, Chap. 8. 

Pbaeson, KAEn: “On the Criterion that a Given System of Deviations . . . 
Can Be Reasonably Supposed to Have Arison from Random Sampling,” 
Phil Mag. (London), Vol. 60, pp. 167^, (1900). 

: “On the Chi-square Test of Goodness of Fit,” Biometrika, Vol. 14, 

pp. 186-191 (1923). 

: “Experimental Discussion of the Chi-squarc Test of Goodness of 

Fit,” Biometrika, VoL 24, pp. 361-373 (1932). 

: “On a New Method of Determining Goodness of Fit,” Biometrika, 

VoL 26, pp* 425H42* 






CHAPTER XV 
CURVE FITTING 
THE PROBLEM 


1x1 many statistical applications one is required to find a 
iinooth curve that is well adapted to indicate the general trend 
of the relationship between var5dng quantities. All with which 
he has to work is a number of plotted points obtained through 
measurement or testing, which points indicate the operation of 
some law of behavior with respect to these variables. The 
choice of the type of curve that would best represent any trend 
depends, of course, upon how we dei^e the term best and upon the 
apparent adaptability of the curve to the data at hand. 

The extent to which the equation of a particular curve is 
descriptive of variation is limited by errors of sampling and 
insufiSciency of data. Whenever experiment shows that some 
law of behavior is being obeyed, we must first assume, therefore, 
that it is expressible to a certain degree of approximation in a 
mathematical formula. We are then at liberty to set up a 
definition of best fitj and to proceed to derive the equation of the 
curve which best indicates the trend of our data. This task is 
known as curve fitting, 

\ 

TYPES OF CtJRVES 


There is a great number of curves which different distribu- 
tions seem to follow. Experience has shown, however, that the 
vast majority of data tend to follow a few types with remarkable 
frequency. The straight line, the parabola, the exponential 
curves of growth and decay, the Gomperta curve, the normal- 
probability curve, and the normal ogive are among those most 
frequently encountered. Their equations are given herewith: 


(A) y ^ mx + b 
(JB) y ^ + + € 

lO y ^ 

(D) y » 


(straight line) 
(parabola) 
(organic growth) 
(organic decay) 
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(E) 


^4-a 

G dx 

—a 

(normal ogive 
curve) 

(F) 

y = 


(Gompertz cxirvo) 

(G) 

11 

(normal-probability 

curve) 


Other equations of the second degree and higher, further 
trigonometi’ic equations, parabolas of the nth degree, and many 
others are perhaps equally important. We shall, however, limit 
our treatment to those listed above and to a cursory account of 
the Pearson system of curves. The methods of curve fitting 
employed here are applicable to many other curves as well. 

METHODS OF CtTRVE FITTING 

There are several ways in which the fitting of curves may be 
accomplished. If the plotted points reveal a straightrline trend, 
we may simply place a thin, transparent ruler, or a cord, over 
them and adjust it in a way we consider best. This method, 
known as the graphical method, requires experience and good 
judgment. It should be used in situations where only moderate 
accuracy is required. 

For straight-line fitting, the method of average's is usually 
superior to the graphical method. The points arc con.sidered in 
two groups, and an average point is taken for each group. The 
problem is then simply that of finding the equation of the straight 
line which passes through these two points. This method .shouhl 
not be attempted unless there is an unquestionable straight- 
line trend, and the points are evenly scattered throughout. A 
disadvantage of the method of averages is that it does not lead 
to a unique equation, since the groupings are entirely arbitrary. 
It is, however, an easy method and may bo used where rapid 
calculations are required. 

Probably the most important method of curve fitting is that 
of least squares. The principle of least squares states that the 
curve of a given typo wMch best fits a given set of points is one 
in which the constants of the equation are so chosen as to rnglfA 
the sum of the squares of the errors a minimum. These errors 
are the amounts by which the actual ordinates of the points fail 
to agree with the ordinates of points on the curve. Thus, if y 
be the ordinate of one of the plotted points, and p be the ordinate 
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of a corresponding point on the theoretical curve, vre are to make 
~ vY S' imnimum. The usual methods of the differential 
calculus are employed for this purpose and, as we shall see later, 
lead to a set of equations known as normal equations. By solving 
these normal equations, we find the values of the constants 
appearing in the type equation which we assumed to indicate 
the trend of the points. The method of least squares is general 
and may be applied to a variety of curves. We shall illustrate 
the least-squares method in the following examples. 


FITTING A STRAIGHT LINE 
Consider the following values of x and y: 


X 

0 

3 


9 

12 

15 

18 

21 

24 

27 

30 

y 

5 

1 

9 

m 

24 

26 

36 

39 

46 

47 

56 

63 


When those values arc plotted on graph paper (Fig. 33), it 
appears at once that there is a general straight-line relationship 
between the two varying quan- y 
titles. Our problem is to deter- ^ 
mine the equation of the line 
which best expresses this relar 45 
tionship, i.e., the equation of jq 
the line of best fit. 

For convenience let us label 15 
the 11 paired items given above 
as {xi,y^, (xs,yi), etc. ^ 5 25 30 x 

Some of these points will fall 

above the line wo seek, and some will fall below it. In other words, 
some of the errors will be positive, and some will be negative. 
But since we are to make the sum of the squares of the errors a 
minimum , we need not be concerned with the negative signs. 
Since the ordinate value of any point on the line is expressed by 
the straight-line equation § = ax + I, these errors— differences 
between the actual and the theoretical ordinate values — may be 
written as follows: 

yi-§i-yi- (.CKCi + 6 ) 

2/2 - §2 “ y* — (a®2 + b) 

2 /* “ =* 2 /» - (<»» + 

etc. 
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According to the least^squares principle wc naust minimize 
2 ( 2/1 — where the summation is to extend from 1 to the 
number of plotted points. In this summation wo may replace y 
by its equal {ax + i). Then the quantity to bo made a minimum 
becomes ^[y — (oa: + 6)]S in which the summation is to extend 
over the total number of points. 

We learn in the differential calculus that in order to make the 
above quantity a minimum or a maximum, wc must have both 
the derivative with respect to a and that with respect to b equal 
to zero. We need, therefore, only to form tho.se derivative's, 
equate them to zero, and solve the residting equations for a and 
V. Squaring the quantity within brackets, we obtain 

2 ( 2 /^ + + b^ — 2axy — 2yb + 2a6a:) 

Summing termwise and removing from under the .summation 
symbol the a and the b which arc independent of the .summation, 
this expression becomes 

S 2 /® + a®Sa;* + nh® — 2a'Sxy — 2?»2y 2a6Sx 

Performing the differentiation with respect to a and then with 
respect to h and at the same time equating the results to zero, 
we have,® 

2oSs® - 2'Sxy + 26Sa: = 0 
2aSa; — 222/ + 2n& = 0 


Transposing certain terms and dividing each equation through 
by 2, 


(H) aS*® 4- hSa: = Hxy 

a2x + bn = "Sy 

In Eq. (H) all the summations are known quantities. Wo 
have, therefore, two simultaneous equations in the unknowns a 
and 6. Solving the simultaneous equations by tho usual meth- 
ods, we find 


_ nSa! 2 / — 2a; • 22 / 
n2«® — (2a:)® 


( 221 ) 


* It may be shown by further mathematical treatment that in the present 
instance tho condition for a minimum, and not a maximum, is satisfied. 

’Observe that when differentiation is performed with respect to a 
particular letter, the others are treated as constants. 
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Sa:® ' 'Ey — Hx • Hxy 
nSa:* - (2a:)2 


(221a) 


Equations (221) and (221a) are general formulas which may 
always be used in finding the constants a and b. It is obvious 
that the method is perfectly general and holds for any number of 
plotted points. All that the worker need do is to compute the 
indicated sums and substitute into these formulas. 

The reader will note the similarity between the form of the 
expression for o and that of the coefficient of correlation r, 
(page 99). It can be seen that if the variabilities in the case 
of an r are made equal (i.e., if <j-® = v^), the formula for r reduces 
to the formula for a. This tells us that a coefficient of correlation 
is the slope of the line of best fit when the variabilities are made 
equal. 

For the example with which we began this development, the 
sums which extend over the 11 items are as follows: 


Ixy = 7,374; Sa: = 165; Sy = 366; 2x^ = 3,465; (n = 11) 

Substituting into Eqs. (221) and (221a) and performing the 
indicated arithmetical operations, we find o = 1.90; 5 = 4.73. 

The equation of the line of best fit, obtained by the method 
of least squares, is, therefore, 


y — 1.90a: 4- 4.73 


THE PARABOLA 

If the plotted points indicate a parabolic trend, we may find 
by the least-squares method the equation of the parabola of 
best fit. Consider, for example, the following 12 values of 
z and y. 


X 

0 

n 



4 

6 


R 




R 

y 

25 


Q 


8 

7 


m 




m 


Those points when plotted (see Fig. 34) reveal an unmistaka- 
bly parabolic trend. Let us assume, therefore, that the desired 
curve is of the form y — ax^ + bz -^e. The constants a, b, 
and c are to be determined from the data by the method of 
least squares. 
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As in the ease of the straight lino, we shall develop the formulas 
for the general ease and then arrive at particular values by 
^ substitution. 



that we must minimize S[j/ 


Our problem is to minimize 
S(7/( — M'horo j/,- stands for 
the ordinate of any of the actual 
points, and the theorei.ioal 
ordinate. But siiuio we aix! as- 
suming that the theoretical value 
of y Ls given by the e.xprossion 
y — ax^ -1- 6a; -f- c, wo may say 
(ax^ + 6a: •+■ c)]®. 


yi(y - ax'- -hx- cy = 22 /* •+• 2o*a:'‘ -f- 26*a:* + 2c* 

— 222 /tta;* — 2'!iybx — 2^tjc 
+ 22oca;* ■+■ 226(:a; + 22a6r'' 


Differentiating in turn with respect to a, 6, and c and setting tho 
derivatives equal to zero, we obtain 


22aa:^ - 222/a:* + 226a:* -f- 22ca:* = 0 
(/) 226a:* - 22va: + 22aa:* 22ca: = 0 

22c - 222/ + 22aa:* + 226a: = 0 

We may take the constants a, 6, and c outside the summaiion 
symbols. Furthermore, 2c = tic. Makitig these changes, divid- 
ing through each equation by 2, and at tho same time rearranging 
the terms by transposition, Eqs. (I) may be written 

a2a:^ -f- 62*® H- C2** = 2a:*2/ 

(J) a2a:’ -f 62** -]- c2* =* 2*2/ 

a2** -f 6 2* -(- TIC =* 22/ 

Equations {J) are the normal equations for tho parabola 
of best fit. We need only to compute the summations for the 
data of our problem and then solve the resulting equations for 
a, 6, and c. Tho sums for the data given above arc as follows; 

2** = 39,974 2*» = 4,366 2** - 506 2* « 66 

22/ = 198 2 * 2 / = 1,328 2**2/ = 12,220 (n = 12) 

Our normal equations are, therefore, 

39,974a -f 4,3666 -|- 506c = 12,220 
4,356a -f 5066 -f 66c » 1,328 

506a + 666 + 12c « 198 
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Upon sfllving these equations by the ordinary methods of 
elimination, we find a = 0.94, h = -8.66, c = 24.44. Fence, 
the equation of the parabola of best fit is 

y = 0.94a:* - 8.66a: + 24.44 

We have seen that in the cases of the straight line and the 
parabola the task of obtaining the equation of the curve of 
best fit by the method of least squares is a direct one of minimizing 
errors — differences between actual and theoretical scores. The 
process leads to seta of normal equations which involve certain 
summations as the coefficients of the unknown parameters of 
the selected theoretical curve. Since the method is general and 
the results are unique, Eqs. (221) and (221a) may be regarded 
as formulas for straight-line fitting, and Eqs. (/) may be taken 
as the set of equations which yield the parabolic coefficients. 

CURVES OF GROWTH AND DECAY 

The problem of fitting curves of growth to a given set of data, 
is, in general, morc complicated than that of fitting straight lines 
or parabolas. Especially complicated is the situation in which 
there is a tendency toward saturation or maturity in the later 
stages of the development of the 
growth factom. 

In the case of organic growth 
under ideal conditions, where 
the increments of growth are 
continuously accumulating, we 
may simplify our task by first 
transforming the assumed equa- 
tion into another form and then 
working with this latter form. 

We simply take the logarithm of each member of the assumed 
equation. This puts the growth curve in the form of a straight 
line. Consider, for example, the following seven values of 
X and y. 


X 

■w 

1 

2 

3 

4 

■B 

6 

y 

■1 

15 

20 

40 

90 




Tht^ data reveal a trend of growth of a certain nature (Fig. 
36). There appears no tendency toward saturation or maturity 
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as we proceed with increasing values of the time factor x. We 
may assume, therefore, that the variation in growth can well 
be approximated by Eq. (C), y = The mathcraaiical 

justification for this conchision rests, as we shall sec later, upon 
the straight-lino trend of the log values obtained by taking 
the logarithm of the y values of the above list. Wo shall rewrite 
our list of paired vahics and include these log y values. 


X 



2 

3 

4 

5 

6 

y 



20 

40 

90 

150 

300 

logy 



1.30 

1.60 

1.95 

2.18 

1 

2.48 


The log y values are plotted against the x values in Fig. 36. 
Here we observe a straight-line trend of log values. Now lot 
us study the nature of our assumed type equation. Wo have 
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y =L 56+*“. Take the logarithm (base 10) of each member; 
then log y = log Since the log of a product equals the sum 

of the logs of the individual factors, w'c may write 

log y = log + log 6 

By the exponential law of logarithms, the first term on the right 
naay be written m log e. Hence, our equation becomes 

log y = a* log e -b log 6 * 

Now log e (base 10) equals 0.4343. Therefore, 
log y = 0.4343a® + log & 

This equation is a straight-line form if we let Y = log y, 

A = 0.4343O, 

B = log That is, our equation is of the form F <=* + B. 

Moreover, our problem has been reduced to that of finding 
the straight line of best fit for our data when expressed in terms 
of log units which vary with the original x units. In addition, 
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wo have justified the selection of the type (C) curve to fit the 
data. 

To complete the problem, we have only to make use of the 
formulas (221) and (221a)— using Y (log y) in place of the y 
appearing therein. The summations required are as follows: 


2xY = 42.14, Sx® = 91, sy = 11.69, 2a: = 21, n = 7 
Substituting these values into Eqs. (221) and (221o), we find 


_ 7(42.14) - (21) (11. 69) ,, 

7(91) - (21)2 - 0 

_ (91)(11.69) - (21)(42.14) ^ 

7(91) - (21)2 “ 


One form of the equation of best fit is, therefore, 
y = 0.25a: + 0.91 


or, log j/ = 0.25a: 4- 0.91. This latter form may be expressed 
in exponential form in either one of two ways. Since log y 
is taken to the base 10, wo may write as a consequence of the 
definition of a logarithm, y = iO“-2'i-<+o.9i_ Rearrange the right- 
hand member by the law of exponents for multiplication. 
y = 10‘’-26* • 10“-2i 

Now it is easily verified that 10®-®* = 8.1. Hence, 
iK) 3/ = 8.1 • lO®-®!!* 

Equation (K) is satisfactory as a final working form of the 
equation which best fits the data of our last list. The reader 
will observe that in place of e raised to the variable power, we 
have during the process changed to the number 10. This, of 
course, is not necessary; it may readily be put again in terms of 
e, as follows: 

Let l0®-2** = e®*, in which we wish to determine the value of c. 

Take logarithms (base 10) of both sides. 

log 10®-2»* = log e®* 

Since the log of a quantity to an exponent equals the exponent 
times the log of the quantity, 


0.25® log 10 =■ c® log e 

Now make use of the facts that Log 10 (base 10) = 1, and that 
log e (base 10) «= 0.4343. Then 0.25® — 0,4343c». 
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Divide through by 0.4343a:. c = 0.57. Hence 

]^Q0.25* _ j0.r>7» 

Substitute into (7v), and wo obtain 
(L) y = g.lc"-”* 

Equations {K) and (L) are entirely equivalent. Either of 
them may be regarded as that equation which is expressive 
of the growth variation indicated by the data with which wo are 
working. A curve of this type is known as a curve of organic 
growth. It is frequently encountered whenever the conditions 
are nearly ideal and whenever there is no tendency toward 
saturation or maturity during the time measurements an; being 
made. 

Equation (D), in which the exponent is negative, is known as 
the curve of organic decay. It may be regarded as a growth 
curve in wlrieh the increments are continuously falling off as 
the variable x increases. A graph of a theoretical curve is given 
in Fig. 37. The method of fitting the curve of organic decay 
y is the same as that of fitting the 

I curve of organic growth.. In 

\ either case the worker should 

be reasonably certain that his 
assumed curve is representative 
— of tho data at hand. The test 

0 ' X of selection lies in taking loga- 

rithms of the y scores (growth 
measurements). If these log values, when plotted against the 
X scores (units of time), indicate a straight-lino trend, the assumed 
curve may be considered predictive of the growth of the factor 
under consideration. 

The problem of growth curves in general has received consider- 
able, attention in recent years. Many empirical formulas have 
been developed-, and many theories concerning tho nature of 
growth have been developed. Pearl has shown that the curve 
of population growth (an S shaped logistic curve) is applicable 
to many forms of growth.^ He has also given evidence that the 

‘ Pbabl, Eatmond, The Biology of Popidati n Growth, Alfred A, Knopf, 
Inc., 1925; also Studies in Human Biology, Williams & WiUdns Company, 
1924, Part IV. 
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same generalized curve deals excellently ■with, unsymmetrical 
as well as with symmetrical growth.^ Bass-Becking defines 
growth in terms of cell growth. In certain forms of develop- 
ment he finds gro'wth best expressed as the differential quotient 
of cell volume increase and time interval. He has pointed out 
the interesting fact that whenever small cells grow at the same 
rate as large cells, a normal distribution of cells reappears after a 
finite number of growth periods and cell-division periods. This 
indicates the applicability of the normal ogive curve (the curve 
obtained by summing the ordinates of a normal curve) in certain 
situations. Peters believes that the curve of gro-wth in ideational 
learning may be the ogive. ^ He gives both theoretical and 
empirical reasons for his hypothesis. L. L. Thurstone has found 
that the hyperbola seems best to fit the norms' of 40 tests, and 
claims this type to be the curve of learning.® As Peters has 
pointed out, the hyperbolic trend is due to the fact that the 
material used by Thurstone involves only the upper levels of 
gro'wth and consequently does not take into account the possible 
influence of the early learning increments upon the theoretical S 
shape. 

THE NOEMAL OGIVE CURVE 

Type (E), which is shown at the beginning of this chapter, is 
the mathematical expression of the theoretical normal ogive. 
As the equation indicates, it is the curve resulting from integrat- 
ing the normal-curve function. Empirically, this amounts to 
summating the ordinate values (z scores) of the normal distribu- 
tion of data wc have at hand. Figure 38 shows the normal ogive 
in relation to average scores from the Peters General Information 
Test. 


THE GOMPERTZ CURVE 

Perhaps one of the curves most applicable in biological and 
psyoholo^cal research is the well-known Gompertz curve.* 

‘ Pbabl, R., and L. J. Rued, “Skew Growth Curves,” Proc. Nat. Acad. 
Sci., Vol. 11, pp. 16-22 (1925). 

* Peters, 0. C., Foun^tions of Educational Soeiologt/, rev. ed., 1980, The 
MaomUlaa Company, pp. 462-466. 

•Thurstone, L. L., “The Learning Curve Equation,” PsycAologieal 
Monographi, Vol. 26, No. S (1919, No. 114), 

* GiOMPEETZ, B., “On the Nature ol the Function Expressive of Human 
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S. A. Courtis has begun with this formula as a basis, type 
and has attempted to show a certain universality underlying 
all biological growth.’- A feature of the work of Courtis consists 
in transforming the formula developed by Gompertz into a 
straight-line form by twice taking logarithms of each member of 
the original equation. He has shown that under standard con- 
ditions log log values of the percentages of development are 
directly proportional to the times in which changes in develop- 
ment occur. This means that the relationship between time and 
log log values may be represented by a straight line. In other 
words, the percentage of development increases to equal powers 
of itself in equal periods of time. 



In order that the reader may become acquainted with the 
gro-wth measurement mcthod.s of Courtis, w(5, shall give a brief 
discussion of the mathematical theory underlying Iris work and 
follow this with an illustration.* 

The equation of the Gompertz curve is 

{M) y — ki'* 

in which y represents measure of growth at the time t, k the 
value at maturity, i the initial dcv<‘lopmont, and r the rate of 
growth. If we take fc to bo 1 and write our equation 

(JV) y = 


Mortality, and on a Ne-w Modo of Determining the Value of Life Contin- 
gencies," Tram. Roy. Soe. (London), Vol. 116, pp. 613-686, 1826. 

* CouETis, S. A., The Meaeurement of Groioth, Brumfield and Brumfield, 
1932. 

' For a full treatment of the mathematical properties of the Oomperta 
curve, see S. A. Coottib, op. cit 
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oiir growtli is expressed in terms of percentage of development. 
Equation {N) is known as the simplex growth curve. Its fitting 
to growth dal.a depends upon the following development: 

Take the logarithm of each member of (N). 

(O) log y = r‘ log i 

Take the logarithm of each member of (0). 

(P) log log y = i log r + log log i 

Equation (P) is the equation of a straight line, 

(Q) Y = At + B 
in wliich 

(P) Y — log log y; A = log r; B = log log i 

It is evident from the foregoing discussion that if the log log 
values of a given set of percentages of development indicate a 
straight-line trend, our problem is simply that of finding the 
constants A and B, and then returning to the original Gompertz 
curve (M). A is the slope of the line of the log log values, and B 
is the initial log log value, i.e., the value when t = 0. 

The two constants, A and B, may be found by the method of 
least squares whenever a fairly full set of values is at hand, i.e., 
whenever we know the log logs of the percentages of development 
for units of time from incipiency to maturity. However, since 
we are assuming that the percentages of development increase in 
equal powers in equal periods of time, we may take A as the 
mean increase in the log logs from time interval to time interval 
over a known range of time. The initial point B may usually be 
determined from the display of the data. This latter method of 
finding A and B is most conveniently employed whenever but 
two or three points on the growth curve are reliably known and 
we wish to interpolate for the others, a problem of predicting the 
percentages of development for the entire growth period on 
the baas of a few known percentages, rather than of obtaining the 
formula expressive of the nature of growth of the organism^ when 
measurements have been taken throughout its entire existence. 

Let us now apply our methods to the fitting of the data listed 
below. The data are percentages of boys passing No. 20, 

» The word organim is here used in the group sense. It is the totality of 
elements which compose the distribution of the growth data. 
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S. A. Courtis has begun with this formula as a basis, type (P), 
and has attempted to show a certain universality underlying 
all biological growth.^ A feature of the work of Courtis consists 
in transforming the formula developed by Gompertz into a 
straight-line form by twice taking logarithms of each member of 
the original equation. He has shown that under standard con- 
ditions log log values of the percentages of development are 
directly proportional to the times in which changes in develop- 
ment occur. This means that the relationship between time and 
log log values may be represented by a straight line. In other 
words, the percentage of development increases to equal powers 
of itself in equal periods of time. 



In order that the reader may become acquainted with the 
growth measurement methods of Courtis, we. shall give a brief 
discussion of the mathematical theory underlying his work aaid 
follow this with an illustration.* 

The equation of the Gompertz curve is 

(M) y = 'ki^‘ 

in which y represents measxire of growth at the time t, k the 
value at maturity, i the initial dcsvclopmont, and r the rate of 
growth. If we take fc to bo 1 and write our equation 

(iV) y = ir‘ 


Mortality, and on a New Mode of Dotennining the Value of Life Contin- 
gencies," Trans. Roy. Soc. {London), Vol. 115, pp. 613-686, 1826. 

> CouETis, S. A., The Measurement of Orowth, Brumfield and Brumfield, 
1932. 

* For a full treatment of the mathematical properties of the Qomperti 
curve, see 8. A. Covetis, op. oit 
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our growth is expressed in terms of percentage of development. 
Equation (iV) is known as the simplex growth curve. Its fitting 
to growth dai.a depends upon the following development: 

Take the logai’ithm of each member of {N). 

(O) log 2/ = r‘ log i 

Take the logarithm of each member of (0). 

(P) log log j/ = < log r + log log i 

Equation (P) is the equation of a straight line, 

(Q) Y ^ At + B 
in wliich 

(P) Y = log log y; A = log r-, B = log log i 

It is evident from the foregoing discussion that if the log log 
vahies of a given set of percentages of development indicate a 
straight-line trend, our problem is simply that of finding the 
constants A and B, and then returning to the original Gompertz 
curve (M). A is the slope of the line of the log log values, and B 
is the initial log log value, i.e., the value when t = 0. 

The two constants, A and B, may be found by the method of 
least squares whenever a fairly full set of values is at hand, i.e., 
whenever we know the log logs of the percentages of development 
for units of time from incipiency to maturity. However, since 
we are assuming that the percentages of development increase in 
equal powers in equal periods of time, we may take A as the 
mean increase in the log logs from time interval to time interval 
over a known range of time. The initial point B may usually be 
determined from the display of the data. This latter method of 
finding A and B is most conveniently employed whenever but 
two or three points on the growth curve are reliably known and 
we wish to interpolate for the others, a problem of predicting the 
percentages of development for the entire growth period on 
the basis of a few known percentages, rather than of obtaining the 
formula expressive of the nature of growth of the organism^ when 
measurements have been taken throughout its entire existence. 

Let us now apply our methods to the fitting of the data listed 
below. The data are percentages of boys passing No. 20, 

‘ The word organism is here used in the group sense. It is the totality of 
elements which compose the distribution of the growth data. 
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Fingers, of the Binet Test.^ These percentages are distrihuted 
according to the chronological ages of the boys, and our problem 
is to find the equation of the curve which expresses the growth in 
their ability to pass the test. 


Pbrckntages of Boys Passing the Binet Test, No. 20, Finoeiis, at 
Different Age Levels 


Age in years 

3.5 

4.5 

1 

5.5 

6.5 

7.5 

8.5 

9.5 

10.5 

Per cent passing 

0.0 

28.4 

(52.5 

86.0 

95.3 

98.6 

09.3 

100.0 


Before going further we must make sure that we undomtand 
how to use log logs. I^et us see how thcKse values arc found. 
Log 28.4 per cent = log .284 = (9.45332 — 10) (from tables). 
This may be written log .284 = —.54668. Now the log of a 
negative number does not exist. We, therefore, define thti log 
of this negative quantity to be the log of the product of this 
quantity and —1. This amounts to disregarding the minus 
sign appearing before .54668. Hence 

log log .284 = log .54668 == (9.73773. - 10) 

(from tables). That is, log log .284 = —26227. The follow- 
ing may be taken as a working form when finding the log logs of 
decimals: 

log .625 = (9.79588 - 10) = -.20412 
log log .625 == log .20412 = (9.30988 - 10) « -.69012 

The reader should prove that he understands the process of 
using log logs by obtaining -1.18376, -1.67966, -2.21326, and 
—2.61670 as the log logs of .860, .963, .986, and .993, respectively. 

Now let us examine the log logs of the limits of our range of 
percentage values. We have log .000 ==-<». Therefore, 
log log .000 = log 00 = oo. Also, we have log 1.000 « .00000. 
Hence, log log 1,000 = log .00000 « -oo. This tells us that 
we are unable actually to reach the true points of initial develop- 
ment and maturity through the mathematical machinery of the 
Gompertz curve. We may, however, make our errors in these 
respects as small as we wish if our measurements are so fine that 
we may approach the limits of the percentage range sufficiently 
far. It is for these theoretical reasons that wa must be content 
> BtTET, C., MenM and Scholaatio Tests, P, S. King & Son, Ltd., Loadou. 
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with an arbitrary point of incipiency, and consider maturity as 
100 per cent development as measured by some natural standard. 

We are now in a position to return to the illustration of per- 
centage of boys passing the Binet test, just quoted. Choose 
as our starting point the age 4.5 years. This is the first year (or 
period in our time scale) that any growth has been recorded. 
At this point we may consider t equal to zero, and label the 
remaining periods 1, 2, 3, etc. The log logs corresponding to 
these time units are given above and are plotted in Fig. 39. 


-Y 



It is evident fi-om the graph that the relationship between 
time units and log log percentage values is linear in trend. We 
may find the equation of the line which best expresses this rela- 
tion.ship by the Icastnsquaros method. To do this, we have 
merely to apply formulas (221) and (22 lo) of this chapter in 
order to compute the required constants A and B. Observing 
that we are using t instead of x and Y instead of y, we have as 
formulas 

, _ nlAY - - S<S«F 

^ ~ nSi* - (20“ ' w2«* - (20® 

The necessary sums to be substituted into these formulas are, 
of course, obtained from our log log data on page 438. They 
are (as may readily be verified) as follows: 

2«F = -29.62809, 2< = 15.00, 2F = -8.5475 
2<® = 55.00, n =« 6 

When th^e values are substituted into the above formulas 
and simplifications are made, we find that A = —.4666, and 
-. 261 ( 6 . 
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Therefore, the equation of our growth curve expressed in 
log logs is 

(S) Y = -.4666i - .2575 

To get back to the original form of the Gompertz curve {N), we 
must now return to Eq. (R), the point at which our departure 
to the straight-lino form began. Wc have, from these equations 
and the results just obi.ained, that A = log r = —.400(5. 

Honce, to obtain r, we must find the anlilog from the tables, as 
follows; —.4666 = 9.5334 — 10. From tlie tables wo find that 
r = .342. Again, wc have B = log log i = —.2575. To oht,ain 
i, we must then twice take antilogs. This is done as follow.s: 
-.2575 = 9.7425 - 10. Thus log f = -.5529, which is the 
antilog of 9.7425 — 10 with a minus sign inserted. (Remesmbor 
that when we found log logs of decimals, wc disregarded the 
minus sign. Thus when taking antilogs, we must insert it again.) 
We shall find i by taking the antilog of —.5529. We see that 
— .5529 = 9.4471 — 10. From the tables we find that i = .28. 

Now the type equation that we assumed to express best the 
growth in the ability of boys to pass the Binct t.c.st is y ®= f’". 
Hence, our final equation becomes upon substituting the values 
of r and i, 

(T) y = .28-»«’ 

Equation {T) is the curve of growth which beat fits the data 
about growth of boys in passing the Binet fingers test. It may be 
looked upon as a formula for estimating percentages of develop- 
ment of boys in their ability to pass No. 20, Fingers, of the 
Binet Test. In practice, however, it may bo found more con- 
venient to substitute values of { into Eq. (dl) and then convert 
these into percentage values by twice taking antilogs. 

Courtis' methods of measuring growth should have wide 
application in the field of education as well as in many other 
branches of science. He has developed tables of isochrons which 
are the percentages of total time to reach maturation that corre- 
spond to percentages of development. ^ The construction of these 
tables necessitated, of course, the selection of an arbitrary range 
of log log values; t.e,, it was necessary to fix upon points of initial 

» These tables may be obtained from the Courtis Standard Tests, 1807 E. 
Grand Boulevard, Detroit, Mich* 
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development and maturity. These limitations do not, however, 
seriously ajffect the practical values of the isochronic system in 
many growth situations, for it has been found that a wide variety 
of growth data agrees very closely in these respects. They do, 
however, limit theoretical generalizations concerning the nature 
of all biologic growth. In addition, it will be remembered that 
the Gompertz formula is expressive of the nature of growth when, 
and only when, the log log values of the percentages of develop- 
ment are linear in tx'end. If these log log values obey some 
other law, then it follows that the growth involved obeys some 
other law.^ 

In view of the minor limitations cited above, the Gompertz 
curve can well be employed in many growth situations. If the 
reader is unfamiliar with the use of logarithms, he may, of course, 
resort to the isochronic tables for ease of computations. The 
writers believe that for the beginner, at least, a fuller understand- 
ing of the basic principles underlying the study of growth curves 
will result from a clearer view of the mathematics involved. 

TESTING GOODNESS OF FIT 

Provided the variates can be grouped into classes so that some 
estimate may be made of the population variance of the constitu- 
.cnt classes, a mathematical test of goodness of fit of our curves 
can be made. As shown on page 328, the formula is 

~ 1 - ie® 

where is the variance of the values computed for the regres- 
sion line — when frequencies are considered — divided by the total 
variance. The reader should refer to our earlier treatment 
and make this test for such tables as our Tables XXVII and 
XXVIII. 

THE PEARSONIAN SYSTEM OF CURVES 

A set of frequency curves representing a wide variety of statis- 
tical distributions has been developed by Pearson.® The equa- 

‘ There is, of course, no limit to the variation of curves that may give rise 
to different log log curves. 

* PnAssoK, Kabl: “Mathematical Contributions to the Theory of Evolu- 
tion,” Trans. Boy. Soc. (London), Series A, Vol. 186, pp. 343-414 (1895); 
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tions of these curves are found by integrating a certain differential 
equation having much support in the theory of probability and 
satisfying certain geometrical properties characteristic of uni- 
modal frequency distributions. They are useful in fitting many 
symmetrical, skewed, J shaped, atid other trends of data, and 
even include the normal curve as a special case. 

The differential equation giving rise to the Pcarsonian system 
of curves is 

I'm ^ = (w - t)y 

^ ' dt a bt ct^ 

in ■wMch m, a, h, and c are constants, and t = x/tr. 

In fitting a Pcarsonian curve to a given set of data, the pro- 
cedure for determining the constants is to express them in terms 
of moments of the system, substituting for those moments those 
calculated from the data. The values thus found determine the 
particular differential equation to be integrated to obtain the 
equation of the cui-ve to be fitted to the data at hand. Kenney 
lists formulas for m, a, b, and c, all of which aro given in terms of 
moments.’' 

After the form of the differential equation has been found, 
integration yields the equation of the type of curve to be fitted 
to the given data. The constant resulting from integration 
may then be found by using the fact that the area under the 
curve is N, the total frequency of the distribution. The equation 
thus arrived at is that of the curve fitted to the data at hand. 

We shall now examine a few types of curves of the Pcarsonian 
system, indicating the form of the differential equations giving 
rise to these types and pointing out how one might proceed to use 
the equations in curve fitting. 

Type VII.— Suppose a given set of data yields the information 
that the quantities m, b, and c equal zero and that the constant a 
equals unity. Then the differential Eq, (U) becomes 


“Supplement to a Memoir on Skew Variation,” Vol. 197, pp. 443-466 (1901); 
“Second Supplement to a Memoir on Skew Variation,” Vol. 216, pp. 429- 
467 (1916). 

’ Kbnnbt, John F., Matkematics of Statisiica, D, Van Nostrand Com- 
pany, Ino,, 1939, Part II, p. 48. 
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Integrating, we find 

y == Ae ^ 

in which A is a constant to be determined from the data. We 
recognize this equation to be that of the 
normal curve and have seen elsewhere 
that A = N The normal curve 
is known as the type VII curve of the 
Pcarsonian system. 

Type III. — If the moments of our data curve, 

are such that c equals zero and m, a, and h are not equal to zero, 
(17) becomes 



(W) 


dt a + bt 


Integration yields an equation of the form 
y A {K + 

in which A is a constant to bo determined from the condition 
that the ar('a under the curve equals N, and K is found from the 
moments. 

In the special case = 1, type III takes the form Type X, 

y = Ae^^ 

which is also known as Laplace’s first frequency curve. 



lha, 41. — Type III curve. Fio. 42. — Type X curve. 


The determination of the constants in the Pearsonian fre- 
quency curves is generally very laborious, involving the computa- 
tion of the first four moments and the area under the curve. 
Examples of the representation of actual frequency distributions 
by several types may be found in A First Course in Statistics by 
D. 0. Jones, and- a rather complete account of all the curves in 
the Pearson system has been set forth by C. C. Craig. Figures 
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of 12 types resulting from different values of the constants are 
shown in H. L. Rietz^s Mathematical Statistics” (Cams 
Monograph)^ Chap. III. 

For further discussions of the I^carson system of curves (.he 
student is referred to Pearsoxx^ and ICIderton.- 

Exercises 

1. Fit a second degree parabola to the data of Ta])lo XXVI IT, pngo 317, 
by the method of least squares, and test the goodiu'ss of fit. How <lo ycnir 
results compare with those we give on page 329? 

2. Fit a third degree parabola to the data of Table XX VT 1 1, 3 1 G, atid 

test the goodness of fit. What other types of curves juiglit lit thcs<^ data 
bettor? 
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CHAPTER XVI 

THE TECHNIQUE OF CONTROLLED EXPERIMENTATION 


To cxporimcni is to control the behavior of animate or inani- 
mate objects while we observe outcomes. Thus the physicist 
has a ball roll down an inclined plane which he adjusts in a manner 
to suit his purposes while he systematically observes the velocity 
or ibc distance traversed by the moving object, the agriculturalist 
treats soils in some predetermined way wldle he takes measured 
sl/Ock of the effects produced by the factors he is manipulating, 
or the chemist brings about certain changes in temperature and 
determines results. In Cwssentially the same manner an educa- 
tionalist applies to groups of pupils two or more different methods 
of teaching and objectively ascertains the relative degrees of 
succ.ess from each in contributing toward the attainment of 
certain specified objectives, or the economist-statesman tries 
municipal ownership of utilities in certain cities and measures 
sxiccess over against the success of such utilities under private 
ownership in similar cities. But, while it is characteristic of 
experimentation in the strict sense to have 'purposive manipula- 
tion of the factors involve'd in the experiment so as to make them 
contiibute with maximum clearness and economy toward the 
answers to the specific questions we want answered, it is some- 
times feasible to find in nature ongoings that so nearly conform 
to what we want that we may utilize them without further 
manipulation. Here selection may replace control. Such 
avoidance of the necessity for artificial manipulation is particu- 
larly convenient to a social scientist. The physicist, the chemist, 
the agriculturalist are permitted to operate on their materials 
at will — ^to lathe down a cylinder until it suits a particular 
purpose, to heat a solution to any required temperature, to 
treat the soil in any manner desired; but a sociologist studying 
adult societies is not at such liberty to manipulate groups of 
people for the sole purpose of his experiment. Neither does the 
economist nor the political scientist have such privilege except? 
perhaps^ on rare occasio3is* The educationalist dealing with 

m 
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school children is able within limits to set up his environment to 
suit the needs of his research, but even he can often control his 
factors only in part and sometimes not at all. Under such 
limitations the sociologist may seek two sets of people who 
happen to differ from each other in the particular respect he 
wishes to investigate while being alike in all other essential ways 
and may use this contrast as a setting in which to study the 
effect of the differentiating factor. In the same manner the 
economist, the political scientist, the educationalist, or even 
the biologist, may take advantage of contrasts that the normal 
progress of events rather than his own manipulation has set up. 
Or the research worker may reconstruct such contras1.s from 
records, thus having a sort of retroactive experimo.nt. Com- 
parisons which depend thus upon selection rather than upon 
control proceed under a heavy handicap, but they involve the 
same fundamental principles and call for the same statistical 
techniques as true experiments. We shall, therefore, have them 
in mind as well as controlled experiments in our discussion 
throughout this chapter. 

In this chapter we are concerned chiefly with experiments 
involving growths of the sort in which students of education 
and the social and biological sciences are interested— growth, s 
not only in biological organism but in ideals, in skills, in informa- 
tions, in folkways, as well. Where growths are normally in 
progress, an experimental factor can have oiily the effect of 
changing the rate of growth. In consequence, wo must always 
measure the outcome in our experimental group against a control 
situation. When an experiment has been conducted without 
such control we do not know how much of the growth to attribute 
to the factor under special study and how much to other factors. 
Normally this control situation consists of a parallel group of 
indiidduals, or a parallel plot of ground, or what not, precisely 
like the experimental one in all pertinent factors except the 
experimental one. For the sake of maximum contrast it is best 
to have this differential factor present in as large degree as possi- 
ble in the experimental group or plot and absent from the control 
situation; but, if that is not feasible, the two situations may 
differ by having the experimental factor present in large d^es 
in the one situation and in small degree in the otheu 
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It seems scarcely necessary for us to say here that care must 
be exercised to keep all other conditions constant in the two 
situations except the one experimental factor; this is the law 
of the single variable, so fundamental to all scientific experi- 
mentation. But to say that the variable must be dngh is not to 
say that it must be atomistic — that it must be simple in the 
sense that it cannot be analyzed into components. Many 
absurd blunders have been made in educational experimentation, 
at least, by overworking the principle of a single variable in the 
sense of a simple variable. In many of the experiments on 
homogeneous grouping of pupils, for example, effort was made to 
keep the type of instruction the same on both sides, the same 
textbooks and the same subject matter — to have, in short, all 
procedures exactly alike except that instructional groups were 
of small range of talent in the experimental groups and of great 
range in the control groups. But the whole purpose of homo- 
geneous grouping, as employed normally in school, is to permit 
differentiation of instructional materials and procedures and 
adaptation of them to the differing levels of ability. When this 
part of the technique of dealing with homogeneous groups was 
discarded what was loft was a more abstraction having nothing 
to do with real educational alternatives. In useful experiment- 
ing we must set one practical Gestalt against another practical 
Gestalt; we must contrast one teaching procedure together with 
all the characteristics that normally accompany it with another 
procedure accompanied by all buttressing elements that would 
normally be used with it; or we must make an experimental 
contrast between one economic system together with all the 
ethical and legal and other drives that go with it to make it 
successful and another economic system accompanied also by the 
buttressing conditions essential to its integrity. In situations 
like this it is true, as the Gestalt psychologists have been pointing 
out, that the whole is more than the sum of its parts. In addition 
to the choice between major alternatives it is proper, of course, to 
make experimental comparison among specific variations within 
any one of the alternatives in order to find the effect of each 
constituent element and the optimum combination of these 
constituents. But, however the variable is defined that is to 
be our experimenttd factor, it must be “sdn^e” in the sense that 
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it must constitute the only essential difference between our two 
situations. 


MATCHING GROUPS 

One of the most important factors to keep equal between the 
two sides is capacity to respond to the stimulus in which the 
experimental factor consists. In the case of learning experi- 
ments, that means capacity to learn materials in question on 
the part of the individuals who constitute the groups. Doubtless 
in experiments in sociology, in biology, in agriculture, and in other 
fields the capacity to respond lies also in constituent parts of the 
groups or of the plots experimented upon, but wc shall direct 
our illustrations chiefly to the sort of situation typified by a 
learning experiment. In order that two groups may be optimally 
matched the mean learning ability should be the same in both 
groups and also the distribution of abilities should be of the 
same shape. It is possible to achieve this by manipulating the 
membership of the groups until the mean scores for capacity 
to learn are the same on both aides, and the standard deviations, 
and perhaps the indices of skewness and kurtosis, are alike. This 
is a perfectly legitimate way. But these ends can usually be 
achieved much more surely and easily by matching individuals 
in pairs. We have on our list, let us say, a student. A, in the 
experimental group with a certain learning score, and we week 
for him a mate, A', in the control group who has the same 
score for capacity to improve. Then we take in the experimental 
group a second person, B, and seek a mate, B'. Thus we con- 
tinue making pairs until we have constructed all that the per- 
sonnel of our two groups permits. For a reason which we shall 
discuss later it is desirable to select and to list these in descend- 
ing order of learning ability, as indicated by the matching scores. 
When groups are matched by this individual-pair method, it 
is automatically provided that the means of the capacity scores 
shall be the same for the two groups and that the shape of both 
distributions of abilities shall be alike. We shall soon see, too, 
that a number of collateral advantages accrue in the interpreta- 
tions of our results. We need not insist upon precisely the 
same scores for the mates, because our measuring instruments 
are so far from perfectly valid that we cannot take seriously 
discrepancies of a few points. Differences as great as 6 or 
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10 per cent of the range are not too much, provided they are 
so balanced between the two sides as to keep the means practically 
the same. It is usually ziecessary to drop some members from 
one or both sides because they cannot be matched, but the 
number should seldom exceed 10 or 12 per cent unless the groups 
as originally constituted differ markedly in average abihty. 
These unmatched individuals may remain with their groups, 
but none of their scores are to be counted in the bookkeeping 
of the experiment. Insistence upon too great precision in match- 
ing is likely to reduce the number of pairs so as to lower reliability 
unnecessarily, while too crude matching results in groups that 
do not sufficiently closely parallel each other in the distribution 
of abilities. If one group is much larger than the other, it would 
be feasible to have several mates in the large group for each 
member of the small group, but the same number of mates for 
each individual.^ 

On what criterion shall we match our groups? Any criterion 
is good that is likely to correlate highly with improvement in the 
function under experimental study; if scores on a criterion do not 
correlate well above zero with improvement in the function 
studied, that criterion is useless for purposes of matching. Scores 
on an intelligence test are frequently used as a basis for matching 
in educational experiments. Intelligence test scores correlate 
only fairly highly with most of the growths mth which we are 
concerned and, in consequence, do only moderately well. But 
in many situations we have nothing better. Usually scores of 
previous academic achievement are more highly predictive of 
success, especially in the same field, than intelligence test scores 
are; hence they make a better basis for matching. For some 
types of experiments the social-economic status of the home 
makes a valuable basis for matching. We can get a safer basis 
for matching by combining several criteria than from a single 
one. The ideal procedure is to pair simultaneously on all of these 
criteria, particularly if they are such as to correlate low with one 
another but each promising a rather high correlation with 
improvement in the trait studied. Also pairs are much harder 
to make than on a single criterion, unless the number of indi- 
viduals to be drawn upon is very large. We are therefore often 

* A method of achieving the effect of matching groups without loss of 
population is discussed later in this chapter, p. 463. 
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forced to the policy of taking an average of the scores from several 
factors. If these arc highly intercorrelated, this averaging 
of several gives us a more reliable measure of capacity just as a 
longer single test would do; but if the intercorrolations are low, 
this averaging becomes abortive, since it makes toward equal 
composite scores for all the individuals. 

Wo suggest the following alternatives in regard to matching: 

1. If the function to be learned is new to the individuals, 
so that no measures of previous attainment are feasible, and if 
no other measures that are known to correlate more highly with 
the function ai'e in sight, match on the basis of one or more 
intelligence tests. 

2. If the persons are somewhat along on the curve of learning, 
match on the basis of good objective measures of present status 
in the function to be experimented upon. Use at least some 
of the same tests, or forms of the same tests, that are to be 
employed at the end of the experiment. We suggest this for 
several reasons: (a) attainment to date is likely to be highly 
predictive of learning ability in the trait considered; (5) matching 
on the basis of initial attainment places the two mates at about 
the same position on the learning curve, and position on the 
learning curve at the beginning of the race has much to do with 
the prospect of improvement; and (c) matching on initial scores 
with which final scores are to bo compared is fairly likely to 
place together mates who have experienced similarly signed errors 
of measurement, particularly if a second criterion is also employed 
as suggested below. 

3. A better basis than any measure of present attainment 
alone is a combination of some measure of present attainment, 
particularly a measure of initial status in the function under 
investigation, and a measure of prospective speed of progress — 
intelligence quotient or educational quotient. These two meas- 
ures should not be averaged but should be used as simultaneous 
bases. 

4. If more criteria are to be employed in matching, we suggest 
that they be combined into not more than two or three different 
types by averaging and that th^e few different types be used as 
simultaneous bases for matching. 

When averaging scores it must be remembered that elements 
in a battery get a weighting in proportion to their variabilities. 
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If, therefore, we intend that the factors shall all have equal 
weight, we must put their scores into forms which have equal 
variabilities. This may be accomplished in several ways: 

1. The scores in each test except one may be multiplied by 
some index that will make all variabilities approximately the 
same. If, for example, we accept A as the basis of one, all scores 
in test B must be multiplied by o-a/cb in order to give factor B 
the same weight in the battery as A has. A corresponding 
thing is true of each of the other tests in the combination. If we 
wish to give multiple weight m to factor S, we can do so by multi- 
plying the scores of test S by mallas instead of cta/vs. 

2. We may reduce all scores to z form by dividing the deviation 
of each from the mean of the scores in that function for both 
gi'oups combined by the standard deviation of these combined 
groups (see page 80). Besides being comparable for all sorts 
of measurements, such “standard scores" have some other 
advantages. 

3. We may reduce all sets of scores to a distribution with a 
standard mean and a standard variability. This amounts merely 
to a modification of method 2. 

MEASUREMENT OP OUTCOMES 

Having matched the groups for apparent capacity to respond 
to the experimental factor and having kept all the factors except 
the experimental one constant while time elapsed for the spread 
of the two groups in growth, our next task becomes the measure- 
ment of progress. The least amount of measurement admissible 
is a test of achievement at the end of the experiment. If, how- 
ever, conditions permit, it is highly desirable to have measure- 
ments of progress from time to time within the course of the 
experiment, so that we may be able to compare the two growth 
curves at several points instead of merely at the end. It is, too, 
highly desirable to have one or more delayed measurements in 
order to ascertain how well the differential advantage persists. 

It is particularly desirable that the measurements be thorough. 
If the tests' employed have low reliabilities, on account of short- 
ness or other limitation, the obtained differences are smaller 
than the true ones. Equally unfortunate is the practice oi 
measuring for only a few, or even only a single one, of the traita 
potentially affected by the experimental factor. When one has 
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gone to the trouble to match groups and to maintain a differential 
in treatment of these groups, it is too bad to stop with less than 
the most nearly complete answer to our question that the situa- 
tion would be able to make. Ideally wo should measure with 
respect to every typo of outcome that might hypothetically bo 
affected by the experimental factor. Gates’ gave a good exam- 
ple of comprehensive measurement wh(',n, in one of his experi- 
ments, he measured differences in seventeen dififorent txaits. 

Later in this chapter we shall return to the discussion of the 
importance of thorough and valid measurements. 

In all careful experimentation the measure employed for con- 
trasting the central tendencies of the groups is the mean, not the 
median. Medians have lower reliabilities than means. Bomev 
times differences ai'O taken in terms of proportion, a.g., (,he 
proportion of pupils elected to student offices from each of the 
groups, or the proportion making honor grades. Wo may also 
wish to compare the variabilities, since one of the methods may 
make for evenness of attainment on the part of the members of 
the group while the other may make for differences among indi- 
viduals. Furthermore, we may desire to measure certain out- 
comes in terms of cocfBcionts of correlation; particularly we may 
wish to know which sort of treatment brings attainments that 
correlate most highly with the mcasuro of learning ability that 
constituted the basis for matching. Wo may desire, too, to 
know what proportion of individuals exceeded their mates by 
each method, and whether those who exceeded their mates in 
the experimental group were at the high levels of "intelligence” 
or at the low levels, or scattered at random through tho 
distribution. 


RELIABILITY OF DIFFERENCES 

Having found differences, our next task is to consider their 
importance. Are they large enough to claim much attention? 
There are several ways in which we can play up our differences 
so as to give to ourselves and to others some rather concrete 
notion of their degree of importance. 

1. We may put them in terms of percentage. We may say 
that the control group gained an excess of 0.43 points over the 

> Gatbs, a. I., "A Modem Systematic versus an Opportunistic Method 
of Teaching,” Teach. CoU. Rec., Vol. 27, pp. 679-700. 
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experimental group which is 6.3 per cent of the size of the mean 
of the latter group; or that the gain by the control group was 
1 18 per cent of that of the experimental group. 

2. We may put tho difference in terms of the period of time 
normally required for making as much progress. Thus we may 
say that the mean of the experimental group exceeded that of 
the control group by an amount equal to 3 months of educational 
ago, or by half as much as the normal gain between the freshman 
and the senior year in a typical liberal arts college.’^ 

3. We may put the difference in terms of standard measures. 
This wo do by dividing the difference between the means by the 
standard deviation of the scores of the two groups combined. To 
put tho difference thus in terms of standard deviations is to give 
to it a moaning that is the same for all sorts of measurements 
and all sorts of situations and is a highly desirable practice. 

4. We may show how far our obtained difference is from a 
chance one, and, consequently, what degree of assurance we may 
have that it will not turn in the opposite direction with further 
sampling. This is the matter of reliability and is dependent 
upon the size of the groups as well as upon the size of the differ- 
ence. Since it does not turn upon the absolute size of the 
difference but upon a combination of this and the size of the 
population, it does not belong in the same category as the pre- 
ceding three. Indeed a good interpretation of a difference 
(especially between means) should include both one of the previ- 
ous three showings and this one on reliability in addition. 

In our chapter on Reliability of Differences we gave the neces- 
sary formulas for the computation of these reliabilities. We shall 
here merely apply some of them to a typical experiment. We 
choose for this purpose part of a small experiment by John A. 
Cooper (Pennsylvania State master’s thesis on “The Relation of 
Participation in College Athletics to Academic Success as 
Measured by Objective Tests”). The data we wish to use are 
set forth in Table XL. The students were matched on intelli- 
gence test scores and attainment was measured by the Carnegie 
Foundation Test for College Seniors. The differences by pairs 
of matched students are given in the column farthest to the 
right. 

The mean of the athletes' score is 507, that of the nonathletes 
530, and the difference 23. This last quantity tallies, as it 
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Table XL,— Comparative Scores of Matched Athletes and 
Nonathletes on the Carnegie Achievement Tests at 
Pennsylvania State College, 1928 


Athlete 

— 


Noimthletes 


Student 

Intelli- 

Achieve- 

Stu- 

Intelli- 

Achieve- 

Differ- 

gence 

score 

ment 

core 

dent 

gence 

score 

ment 

score 

enco 

D 

81 

529 

C 

81 

426 

+103 

F 

79 

410 

P 

79 

332 

+ 78 

M 

91 

583 

N 

91 

797 

-214 

P 

96 

380 

F 

94 

486 

-106 

R 

90 

580 

H 

89 

656 

- 76 

s 

115 

589 

R 

109 

514 

+ 75 

V 

73 

539 

0 

73 

480 

+ 50 

c 

116 

824 

B 

124 

751 

+ 73 

M 

98 

506 

H 

98 

538 

- 32 

M 

105 

832 

F 

105 

455 

+377 

W 

95 

595 

A 

95 

799 

-204 

B 

95 

592 

R 

93 

664 

+ 28 

F 

99 

286 

B 

102 

599 

-313 

A 

92 

397 

P 

92 

638 

-241 

B 

96 

350 

P 

96 

588 

-238 

M 

87 

582 

H 

87 

491 

+ 91 

R 

97 

544 

H 

97 

630 

- 86 

s 

64 

346 

M 

64 

526 

! -181 

J 

89 

642 

B 

89 

545 

- 3 

p 

90 

692 

M 

90 

590 

+ 2 

S 

61 

535 

N- 

63 

466 

+ 69 

E 

75 

389 

W 

75 

372 

+ 17 

M 

119 

857 

K 

115 

584 

+273 

E 

111 

571 

B 

111 

537 

+ 34 

K 

88 

555 

F 

88 

541 

+ 14 

M 

95 

511 

G 

97 

477 

+ 34 

D 

76 

484 

F 

76 

382 

+102 

T 

67 

408 

M 

71 

637 

-129 

R 

85 

623 

H 

84 

284 

+239 

B 

89 

387 

G 

59 

343 

+ 44 

G 

89 

381 

G 

89 

870 

-489 

G 

89 

356 

A 

87 

467 

-111 

C 

63 

362 

B 

62 

417 

- 55 

E 

81 

375 

E 

84 

544 

-169 

M 

75 

569 

K 

72 

420 

+149 

W 

77 

394 

M 

’ 77 

424 

- 30 

Means 

88.6 

607 


87.6 

630 

- 23 

Sigmas 

.... 

1S6 

- . 

14.9 

130.44 

166.25 


Intelligence score call factor 1; athletic-achievement score, 2; and non- 
athletio achievement score, 3* rn .664, ru <-• .492, rn «" .216. 
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must, with the sum of the differences by pairs (last column) 
divided by N. By formula (95), the standard error of this 
difference is 


^ ^ 166.25 


27.7 


The ratio of the difference to its standard error is 


t = 


23 

27.7 


0.83 


This is far short of the conventionally demanded ratio of 3. But 
as we pointed out earlier, there is no magic in a ratio that reaches 
exactly 3, although it is true that near this point the odds against 
reversal begin to mount extremely rapidly with increasing ratios. 
On pages 169 to 170 we explained the method of interpreting 
such ratio of the difference to its standard error. Reference to 
the table of integrals of the normal curve shows that, if the true 
difference were zero, we would expect to obtain a difference as 
much as 0.83 standard errors above zero in 0.203 of the trials 
while we would expect the opposite in .797 of the trials. The 
chances are, therefore, 3.9 to 1 that the true difference is in 
favor of the nonathletes. 

Are athletes more variable in attainment than nonathletes? 
The standard deviation of the scores of the former is 135 while 
that of the latter is 130 a difference of 5. Is that a reliable 
difference? The reliability formula required here is (104) 

/vid- <ri — 2 / 18 ^ 20-8 
“ V 2N 

The r here is .215 which when squared gives .04. To use this r 
hero will really make only an insignificant difference, but we shall 
do it anyway in order to illustrate the principle. Then 

/ 13S» + 130^ - (2) (.04) (135) (130) _ g 
Dividing the difference by its standard error, we get 



0.23 
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This is too small a ratio to give any appreciable assurance that 
further sampling will not show the true difference to lie on the 
opposite side. The odds are only 1.5 to 1 that the true difference 
lies in the indicated direction. 

We have made here the “large sample” type of interpretation, 
which is appropriate for an N of 36. This fonn of interpretation 
assumes that a-a — vs is distributed normally. As a matter of 
fact, the distribution of standard deviations from samples is 
not normal and neither, in consequence, is that of tho difference 
between standard deviations. But they approach normality as 
N increases, and, with iV = 25 or more, the error in taking them 
to be normal is small and is not very great even with an N as low 
as ton.^ But for an “exact” interpretation in small samples the 
probability of getting in a sample a divergence between <r’s a.s 
great as tho one in hand must be determined from the distribution 
of si/s 2 in the manner discussed on pages 335 to 337. The 
probability of getting a given divergence as measured by this 
ratio is tho same as the probability of getting tho same divergence 
in the form of a difference between these same sample values, 
because it is the probability of getting simultaneously sample 
values as far apart as these or farther when the true difference is 
zero. 

Do the attainments of athletes correlate more highly with 
“intelligence” than those of nonathletes? In order to determine 
this, we must compute the r’s between intelligence test scores 
and achievement test scores for both the athletic and nan- 
athletic group. For the athletes this r is .564 and for the non- 
athletes it is .492. There is a difference of .072. Foi*mula (107) 
would be the correct one to use. But in practice wo usually 
ignore the r between the r’s unless very precise results are rcxiuirod 
with a popuiation large enough to justify such attempts at 
precision. In view of the low correlations in our problem, and 
the smallness of our population, we shall use formula (109) which 
is not only suflB.ci6nt for our purpose here but will usually be 
sufficient when comparing the r's in controlled experimentation. 

+ = V.0191 -f- .0210* « .20 

The ratio of the difference between the r’s to the standard error 

* See Phabson, Kabii, Biometrika, Vol, 10, p. 629; or Dsmino and Biaon, 
“Theory of Statistical Errors,” Bee, Modem Phya., Vol. 6, p. 129. 



TECHNIQUE OF CONTROLLED EXPERIMENTATION 457 

of that difference is .36, which is again too low to have satisfac- 
tory statistical significance. 

The difference between the means is 0.18 standard deviations. 
In spite of the fact that the difference between the means is 
slightly in favor of the nonathletes, only seventeen of the non- 
athletes exceeded their mates in achievement score while nine- 
teen athletes excelled. These advantages are scattered so 
miscellaneously over the range as not to suggest any relation 
between intelligence and the effect of athletic participation upon 
scholarship. This experiment shows slight if any difference in 
academic attainments between athletes and nonathletes at the 
college level. If there are real differences, our number of sub- 
jects is too small to demonstrate them. A little later we shall 
discuss the question of number of cases required to show decisive 
results where there are true differences but very small ones. 

The example treated above employed measurements of only 
end differences. Table XLI gives data from an experiment in 
which mea-surement is in terms of gains. It is from a Pennsyl- 
vania State College master’s thesis by Boyd M. Beagle on the 
effect of technical analysis in the teaching of appreciation of 
poetry. The experimental group is the one for which technical 
analysis had a place in the teacWg between the time of taking 
initial measurements and the time of final measurement, while 
from the teaching of the control group such analysis was absent. 
Our formula for reliability in such application is (97), given on 
page 168. It is left for the reader to apply, as are also the other 
desirable interpretations. 

The most carefully controlled experimentation involves well- 
matched groups. But sometimes experimenting is done with 
random groups. This was especially true of the early experi- 
ments, but sometimes occurs at present. A notable recent 
example is An Bxperimenial Study of the Educational Influences 
of the Typewriter in the Elementary School Classroom by Ben D. 
Wood and Frank N. Freeman. When the number of individuals 
or groups compared is very large, random selection is fairly 
likely to bring about near equality in learning ability between 
the two sides. But even in the Wood-Freeman experiment, 
involving nearly 15,000 pupils, differences between the groups 
in scores of aptitude were sometimes appreciable, as were also 
differences in the average quality of the teachers on the two 
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Table XLI, — Scores in Judging Poetry by an Experimental and a 
Control Group — Abbott-Trabue Test 



P.N. “ pair number. 

E.S. » end score. 

D.G. «• difference in gains. 
LS. «* initial score. 

G. « gains. 
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sides. A very much smaller number of subjects carefully 
matched would give more decisive and less ambiguous results 
than a larger number only loosely matched. 

When random rather than matched groups are employed, the 
r in the third term of the reliability formulas is to be regarded 
as zero, so that the third term drops out. For difference between 
means, the formula then becomes 

This formula is frequently employed even when the contrasted 
groups have been matched. Then the obtained standard error 
of the difference is higher than it should be, and the indicated 
reliability is too low. It may bo worth while to ask how much 
too low. If the correlation were perfect and the two standard 
deviations were equal, the would completely offset 

the so that the resulting standard error would be 

zero, if the r = .50, the residuum under the radical would 
be half as great as ff the r were not considered and hence the 
standard error, V^O or .70 as large. If the r were only .20, 
the standard error would be -s/iSO = .89 as much. So, when 
the r is large, consideration of it makes a vast difference, particu- 
larly in view of the fact that the odds increase much more rapidly 
than the standard error decreases; but, when the r is small, the 
effect of its consideration is negligible. 

If the r belongs and has not been used, it may be of interest 
when evaluating an experiment to speculate on the amount of 
error involved. The amount of correlation to be expected 
between the end scores may be inferred from the r between the 
matching factor and the end scores, which is sometimes given 
and more often can be roughly guessed. If the two end arrays 
are imcorrelated except through the matching factor, the partial 
r with the matching factor held constant will be zero. Thus, if 
the subscript 1 refers to the matching factor and 2 and 3 to the 
two arrays of end scores. 


rn.i = 


Tis — riiTn 


Vl - rliVl - >13 
Clearing of fractions and solving, 

m - ruTia * 0 

Tsz = riifij 


= 0 


( 222 ) 



460 


STATISTICAL PKOOliDURKS 


Thus the cross correlation can be expected to bo ihe ju-oduct 
of the r’s between the matching scores and the scores in each 
of the end arrays. If the two r’s between matching and final 
scores are equal, the r b<^twecn the arrays of (md scores is the 
square of the r between end scores and mat<diiug s<!ores. If 
subjects are matched on intelligence test scortis and achievement 
is measured in terms of school grades, a correlation of from 
about .30 to .50 may be expected between matching scores and 
achievement so that the cross correlation may bo expected to 
run from .09 to .25. If matching Is done on an objective achieve- 
ment test closely related to the final one, an r of .70 or .80 may bo 
expected between matching and achievement arrays and an r 
between the two arrays of end scores of .49 to .64. 

A trial of this formula on Cooper’s data. Table XL, gives 

ra, = (.564) (.492) = .277 

The correlation obtained by computation is .215. In so small 
a population the assumptions arc not fulfilled sufficiently well to 
give more than a reasonable approximation to the correct r. 

ON CORRELATIONS WHERE GAINS ARE MEASURED 

If measurement is made in terms of gains between initial and 
final status, the r’s between the gains by the two groups must bo 
expected to be very low except where the subjects are near the 
beginning of the growth curve in the function under study at 
the time the investigation begins. That is because, as the curve 
flattens out, gains correlate much less with initial scores than 
end scores do, so that, when squared, these r’s suggest practically 
a zero correlation between the two arrays of gains. An incroascj 
in standard deviation between initial scores and final ones 
suggests a positive correlation between gains and initial status, 
while the absence of an increase or an actual decrease in the 
standard deviation suggests a zero or a negative correlation. 
The chief factor in making toward such low or negative correla- 
tions between gains and initial status is unreliability in the tests 
used for measuring gains. We have been able to show (although 
we Shan not here consume the necessary space to give the deriva- 
tion) that a negative correlation between gains and initial 
status in the same function in which the gains are measured is 
attributable to unreliability in the measuring instrument and 
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that this correlation has the following magnitude: 

- rii) (223) 

where Xi is an initial score in the function, is the reliability 
coefficient of the test, and is that part of a gain between first 
and second testing that is due solely to the unreliability of the 
testing instrument. If the matching is not on initial status in 
the function in which gains are to be measured but on some 
outside criterion instead (say a general intelligence test, which 
we shall label with the subscript 0), and it is desired to know the 
r between gains due to unreliability and this matching factor, we 
can show that 

roa. = -roiVid - rn) (224) 

It is because the positive r between truly measured gains and 
truly measured initial status only partly offsets this negative 
correlation due to unreliability in the measuring instruments 
that the r between gains and the matching factor so often proves 
to be zero or slightly negative. This argument also shows that, 
where results arc to be measured in terms of gains, matching 
is much less important than where comparisons are in terms of 
only end scores. 

Sometimes the occasion arises to infer what the r would be 
between some experimental factor {x^ and true gains in another 
function. For example, we take initial and final measures of 
academic achievement and thus obtain fallibly measured gfl-ina 
(g). We compute the r between these fallibly measured gaina 
and the extent of participation in extracurricular activities. 
We wish to infer what the r would be with the disturbing effect 
of the unreliability removed. We need, therefore, the r between 
gains and EC A with the gains due to the unreliability of the 
test held constant. Our regular formula for partial correlation is 




VI - 




tea 


The Taaa we can compute from our data. 

Tfga can be shown to equal (2<r»,/<re) V^(i “ ns) 
r»,j, can be shown to equal — — I'n) 


(225) 


(225a) 

(2255) 
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We calculate these several r’s and substitute them in our partial 
correlation formula. 

COMBINING SEVERAL TRIALS 

Sometimes we may wish to combine into a single showing the 
results from a number of trials in an experiment. We then 
need the difference between a sum of means by the experimental 
group and sum by the control group. If individuals have been 
paired, the standard error of such difference is simply the stand- 
ard deviation of the column representing the differences between 
corresponding sums of scores by the paired individuals when 
this standard deviation has been divided by the square root 
of the number of pairs. That is, we make the same combination 
of scores of individuals as we intend to make of means, take the 
standard deviation of the resulting array, and divide this by 
'\/W. This involves formula (98). If subjects are not paired 
individually and yet groups are matched, so that an element of 
correlation is present, the foi'mula for the standard error is 
easily derived by anyone for any combination ho needs as 
follows: 


S(Wl -j- Wls Vti “t” 


— Mi — nii 


me 


S 


- 

~ S 
Sm| 


2^4 _|_ 2m| 


S 


S 


2mf '2m\ 


S 


+ 


3 


+ 


+ 


, 22mim2 , 22mim$ , 
T C( “I 5 T 


3 

22mi7?i4 

3 


3 

2'Smiint 

3 


, 22m4m5 , 22m4m« , 

T o T B T 




3 


+ O'm, + + • 


+ 4- oi, 4" <4 


**• 


. 4- 2ri2<rmj<rmj -1- 4- * • • 

j- Or. ^ ^ ... (Continue with all correspond- 

T ^ 46<rm,o'»j jjjg posaibio combinations) 

If the groups are random ones instead of matched ones, all r’s 
are zero and only the terms of the form remain. But it 
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should be remembered that only closely similar units are to be 
thus additively combined. 

A REGRESSION TECHNIQUE FOR MATCHING GROUPS 

We can employ a regression technique for the hypothetical 
matching of groups, which obviates the necessity of having pre- 
cisely matched pairs. In our control group we determine the 
regression of end scores upon the matching scores. Then we 
predict for each member of the experimental group the end score 
he would be expected to make on the basis of his learning ability 
as indicated by his matching score. If the mean of the obtained 
scores is significantly greater than that of the “expected” 
scores, the experimental factor is indicated as having a differential 
potency in contributing to growth.^ We shall apply this teeh- 
rdque to Cooper’s experiment reported on page 454. We need the 
ordinary rectilinear regression equation and need to make predic- 
tions by the method explained on pages 110 to 112. Letting Xi 
be the intelligence test scores for the nonathletes and Xz their 
final scores, letting XJ be a predicted score rather than an 
obtained one, and employing the numerical values of the sta- 
tistics as computed from Tables XL and XLII, 

X'z = r (Xi) + (m., - r ^ Jf.) 

ffi \ ffi y 

130.44 „ , 130.44 

= ,492 Xi + (^630 - .492 87.5 j 

We now apply this regression equation to predicting what 
should be the final score for each member of the experimental 
group in case the experimental factor had no differential effect. 
To do this we merely enter in succession as 7i the intelligence 
test scores of the members of the experimental group. Rewriting 
the equation in terms of TJ with the complex expressions evalu- 
ated, we have 

Yi = 4.307X1 -f 153.12 

The fihst athlete in the table has an intelligence test score of 81. 
Substituting this for Xi in the regression equation, we predict 

1 This is simflar to Fisher’s covariance technique. Obviotisly it can be 
applied to agricultural or sociologioal or to other data with suitable control 
factors and the substitution of the appropriate outcomes for “growth.” 
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for him a score of 501.99. He actually made a score of 629, so 
that for him Fs — Fg = +27.01. The predicted scores, attained 
scores, and differences for the 36 individuals are entered in 
Table XLII. 

The mean difference of the predicted scores from the attained 
scores is —27.47, so that the athletes had lower scores on the 
achievement test than nonathlctes of corresponding intelligence. 
In order to test whether or not this is a significant difference, 
we need to know the standard error of this mean difference. 
We shall take finst the case where the experimental group and the 
control group have the same N and where the two groups are 
perfectly equated. 

Let y be an obtained end score in the experimental group 
(instead of 2 / 2 , for the moment), and lot y’ bo a predicted one; 
similarly, let xi bo a predicted final score for the control group. 
Let irs take both y and y' as deviations of sample means from the 
means of the whole of thoir respective populations. Then 

a 2 I a n 

oj_5' = 05 + 05' — 

But, in each sample, the mean of the predicted j/' scores is the 
same as the mean of the xi scores (which also equals the mean 
of the a:j scores), since they wore predicted from initial scores 
perfectly equated with the corresponding Zi scores. Hence, 
making this substitution, 

2 


(A) 

Again, in the sample, 

= V* + Vj' “ 

Now because each y' is the corresponding y\ mulla- 

plied by a constant, b. ary> is the standard deviation of the scores 
predicted as lying on the regression line, and (page 240) we 
showed that this equals rcr„. However, since the y’a are pre- 
dicted from the x regression line, xy' «=» Making these 


= 05 + — 2rsjycr2a)i 

~N^N N 

_ <(1 - r *..,) 

JV 


+ 


["N 


4.3 

^ N 


2r, 


I 


N 
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substitutions, we have 

But we showed on page 459 that, assuming no correlation except 
through the matching factor. 

Substituting this and dividing by (iV — 1), 


( 5 ) 


iV - 1 N - N - I ^ iT^l 


But, allowing for the fact that the v’s in (^) are the population 
variances and those in (B) are the sample variances, this quantity 
is the same as the quantity in brackets in (^). We can simplify 
(4) by substituting (B) into it. We also adjust the term outside 
the brackets to the sample value by dividing by (W — 1) instead 
of by N. We then have 



- r^x,) 
N - 1 


+ 


N - 1 


(Sampling variance of 
the difference between 
the means of predicted 
and obtained scores, 
when experimental 
and control groups are 
perfectly equated) 


(227) 


That is for the case of perfectly equated groups. We need 
a more general formula. Since we are using population variances, 
our formula need not be affected by differing N’s for the experi- 
mental and the control groups. But if the mean of the matching 
scores of the experimental group differs from that of the control 
group, we need an adjustment for that difference. In that 
case <rl^ cannot, for the purpose of substitution for Na^', be taken 
from the mean of its own array but, instead, from that mean 
plus b{$i — fi), where 6 is the regression coefficient. The 
variance of this further factor must be added to the variance 
due to the other factors (since it is independent of the others). 
This will give us, for our general case, where the subscripts i 
and / stand for the equating scores and the achievement scores, 
respectively. 





<4,0- - 4^) , , (fit - 

w. - 1 isr, - 1 (W. - i).r|, 


(General formula for the etandard error of the difference between 
means of predicted and obtained scores in an experimental ( 228 ) 
comparison for one matching factor) 
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Table XLIL — Predicted Scores in Comparison with Attained Scores, 
CoopER^s Experiment 


Student 

Intelligence 

score 

Predicted 

score 

j 

Attained 

score 

Difference 

D 

8X 

501.99 

529 

+ 27.01 

F 

79 

493.37 

410 

- 83.37 

M 

91 

545.06 

583 

+ 37.94 

P 

96 

566.59 ' 

380 

-186.59 

R 

90 

540.75 

680 

+ 39.25 

S 

115 

648.43 

589 

- 59.43 

V 

73 

467.53 

539 

+ 71.47 

c 

116 

652.73 . 

824 

+ 171.27 

M 

98 

575.21 

506 

- 69.21 

M 

105 

605.36 ! 

832 

+226.64 

W 

95 

562.28 

595 

+ 32.72 

B 

95 

662.28 

592 

+ 29.72 

F 

99 

579.61 

286 

-293.51 

A 

92 

549.36 

397 

-152.36 

B 

96 

566.59 

350 

-216.59 

M 

87 

627.83 

682 

+ 54.17 

R 

97 

670.90 

644 

- 26.90 

S 

64 

428.77 

345 

- K^.77 

J 

89 

636.44 

542 

+ 5.56 

P 

90 

540.75 

592 

+ 51.25 

s 

61 

415.85 

535 

+ 119.15 

E 

75 

476.15 

389 

- 87.15 

M 

119 

665.65 

857 

+ 191.35 

E 

111 

631.20 

571 

- 60.20 

K 

88 * 

532.14 

555 

+ 22.86 

M 

95 

662.29 

511 

- 51,29 

D 

76 

480.45 

484 

+ 3.56 

T 

67 

441.69 

408 

- 33.69 

R 

86 

519.21 

523 

+ 3.79 

8 

89 

636.44 

387 

-149,44 

0 

89 

1 686.44 

381 

-165.44 

G 

89 

636.44 

366 


C 

63 

424,46 

362 

- 62.46 

E 

81 

501.99 

376 

-126.99 

M 

76 

476.16 

669 

+ 92,85 

W 

77 

484.76 

394 

- 90.76 

Mean 

88.6 

634.63 

607.06 

- 27.47 

Standard deviation 



136 

117.08 
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Applying this formula to Cooper’s data, we get 

_ / (130. 44)X1 - .492^^) 117.08^ a)^C130.44’)^fl - .492^ 

'V 36-1 36 - 1 (36 - 1)(14.9)2 




On page 455 the standard error computed by the customary 
method was found to be 27.7, a result in remarkably close 
agreement with the one found here. But the difference between 
means by that method was only 23 instead of our present 27.47. 
That discrepancy is due to the fact that the two groups were not 
perfectly equated ; the athletes (experimental group) had a mean 
intelligence test score one point higher than the control group, 
and that one point difference in matching score carried the 
expectation of an extra achievement score of just about four 
points. Although for all practical purposes the two procedures 
tell the same story, the regression technique was really more 
accurate than the conventional matched-group technique because 
it showed what would be the expected difference if the groups 
were perfectly matched, as well as the reliability of that differ- 
ence. Of course, in practice we would not employ the regres- 
sion technique where we had the groups already matched, but 
we used it here on that type of problem in order that we might 
make comparisons between the methods. 

For equating on a combination of several factors, y’s should 
bo predicted by the partial regression equation (see Chap. VIII). 
Everything will behave in the same manner as with single matching 
except that the multiple correlation coefficient * 2 , . . . ,i*,) 

will replace in the first term under the standard-error radical 
and the third term under the radical will become 

<[1 - - fiiY 

N» X Oiy • qqi, ■ • • (— ••• it 

where Sif is the mean of any one of the matching factors in the 
control group and is the mean of the corresponding matching 
array for the experimental group, the task calling for the summa- 
tion of all the differences between such matching means squared 
and divided by the partial variance of its own Xi array. 
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For the number of matching variables indicated on the left, 
the partial sigma values required for the denominator are given 
at the I'ight. Beyond four matching factors (if desirable to use 
more than four, which is doubtful), the worker should resort to 
the Doolittle method to compute multiple R for 

• sv, • • • I'l = ~ -Ki/wi ■ • • 

For simplicity we shall write 1, 2, 3, etc., for iiii . . . h. 

No. of 
Variables 

2 Vi-j = a\{l rijs); vl-i = c?i{l rf^) 

3 Vi.jjj = <ri(l ^ia)(l ^la-s) 

o’i-H — <^ 3(1 r|3)(l rfs-s) 

oj.js = <r|(l - rlaKl - ’"is-a) 

4 o-?.234 = <ri(l - r?2)(l - r?,.4)(l - r?4.a,) 

<'’S-134 — ®'i(l ~ ^a3)(l ~ r24.3)(l — rij. 34 ) 

V3.1S4 — “tKI — r| 8 )(l — — rfa-a*) 

vj-iaa “ <’■ 4(1 — ?'84)(1 — r| 4 .a)(l — fu-as) 


The formulas for the required partial r’s can bo found on pages 
243 to 244 of this volume. 

This third term in the standard-error formula is the most 
tedious of all the parts of the work, and yet it makers a trivial 
difference in the value obtained if the groups are reasonably 
close together in the means of the matching elements. If the 
groups are not far from equal in equating scores and no great 
exactness is required, this third term of the standard-error 
formula might be dropped; the worker, then, should remember 
that the obtained standard error is a trifle smaller than the 
correct one. 

The above formulas are based on large sample theory. If, 
because the sample is small, the < is to be interpreted in terms of 
Student’s distribution, each (iV — 1 ) in the denominator should 
be replaced by (iV — fc — 1), where lb is the number of matching 
factors. Then use Table XII or XLV and XLVI instead of the 
table for the normal distribution, entering the table with 

(IV. + JV, - fc - 2 ) 


degrees of freedom. 
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It will bo observed that this technique involves matching 
each experimental subject with a hypothetical one in the control 
group who stands on the same point on the x axis, then comparing 
his final score with that of the mean of a hypothetical class 
of controls who had the same matching score as his. In the 
matched-group technique we equate the actual scores of paired 
subjects and compare the actual end scores of the same two. 

We applied the regression technique to Cooper’s experiment 
for the sake of comparison of methods. Ordinarily we would not 
apply it to that problem because the groups were already satis- 
factorily matched by pairs. The regression technique is particu- 
larly useful where the subjects cannot be paired without too much 
sacrifice in size' of population. The two groups need not be 
exactly equated for means on the matching factor, but to the 
extent to which the control group lies on a different level from the 
experimental group on the matching criterion, to that extent we 
make a hazardous assumption of rectilinearity of regression 
beyond the range of the control group scores. There is no need 
that control and experimental groups have the same number of 
subjects. Each group should be as large as available populations 
permit, although there would be loss rather than gain by includ- 
ing subjects who were clearly abnormal from the standpoint of 
any of the conditions of the experiment. 

INCREASED RELIABILITY FROM REPLICATION OF EXPERIMENTS 

We shall now return to a further consideration of the relation 
of the size of our sample to the reliability of our differences. We 
have had abundant occasion to see that the standard error of a 
difference varies inversely as the square root of the number of 
subjects. When true differences are small, as they often are, it 
is not possible to establish them reliably with such small groups 
of subjects as we may have at our command. Let us get this 
fact before us more vividly in terms of a formula for the number 
of subjects needed to give a standard error of a predetermined 
size when the true difference is believed to be a given amount. 
Let D stand for the true difference and t be the ratio of a differ- 
ence to its standard error upon which we intend to insist. 

. D 

<rm \/(«i + ol “ 2r<ria2)/^ 
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Let us assume that the two o-’s arc equal, 
rearranging the N, 


j. - 

- r) 

,, 2iV=‘(l - r) 

- 2 )* 


Then, squaring and 


(229) 


From a series of experiments' the authors concluded that the 
true difference to be expected from a certain kind of moral 
instruction in school is about 0.4 of a standard deviation. Tak- 
ing this standard deviation i.o be substantially the same as the 
one of our formula (the latter can be made the same by computing 
it from the two distributions combined instead of from one of 
them) and ignoring the element of correlation, the number of 
pairs of pupils indicated to yield a ratio of 3 would be 


N = 


(2)(3^)<r^ 

0.4V^ 


113 


This is the number required to give a ratio as high as 3 in half 
the trials. If wo demand a ratio of 3 in as many as five-sixths 
of the trials, we must substitute 4 for t instead of 3, and our 
required number is 200. 

Since it is often impracticable to have as large experimental 
groups as those suggested above and since many situations 
involve differences that are important even though small, our 
dependence must frequently bo placed upon the reliability of a 
set of replicated experiments. When the outcomes of a number 
of experiments point in the same direction, the reliability of the 
set is much greater than that of any one taken alone and much 
greater, too, than the average of the reliabilities of the several 
samples. We are, therefore, led to the consideration of the 
reliability of a set of experiments. 

It is a fundamental principle of the mathematics of chance that 
if the probability of the occurrence of an event is p under one 
condition and q under another condition, it is pg for the two 
conditions combined. Suppose, then, the probability is 7 in 
100 that a given difference would have been obtained if the true 
difference were zero or less in one experiment and 12 in a 100 

‘ See Journal of Educaiioned Sociology, December, 1938, the whole of 
which number ia devoted to these experiments. 
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that a given other difference would have been obtained if the 
true one were zero or below, the two experiments being entirely 
independent of each other. On the above mentioned principle 
the probability is only (.07) (.12) = .0084 that such differences 
would have been obtained both times in the two independent 
trials if the true difference were zero or below. This same 
principle would hold for any combination of additional probabili- 
ties where always the same type of event occurred; i.e., where 
always the difference turned out on the same side. Thus the 
odds are veiy great that the true difference lies on the indicated 
side when it continues in successive samples to be found con- 
sistently on that side, even though the odds indicated at any one 
trial arc not high. 

When the odds are low at the first few trials, it is extremely 
unlikely that the differences will continue to fall consistently 
on the same side. If they do so, that fact suggests unusual (but 
not impossible) deviation from the laws of chance or else some- 
thing erroneous about the calculation of the probabilities. When 
the odds are low in the individual samples, it is to be expected 
that some advantages will fall on one side of zero and some on the 
other. Even in such case, however, the reliability of a set of 
samples is greater than the average from the samples taken singly. 
In order to put this fact in better perspective, we shall develop 
some statistical formulas expressing the relations involved, not so 
much with the purpose of actually applying them to calculate 
joint probability but rather as a general basis for the interpreta- 
tion of the effect of replicating (repeating) an experiment. 

We assume an experimental factor running through all the 
trials equally potent to separate the contrasted groups in all 
trials, except for the effect of chance errors of sampling. Let 
ni, na, n*, . . . be the number of pairs of individuals in the 
several experiments. Similarly let Di, Da, Da, . . . be the dif- 
ferences between means in samples, and let h, U, U, . . . be the 
ratios of the several differences to their standard errors. Then 


(0) 

If 

(D) 

(Tpi — ' i 

VWi 


where (t* is the standard deviation of the array of paired differ- 
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encos in experiment 1 . Furthermore, Di 


(E) 


JDi = 


Ml 

ni 


Mdi, whence 


Thus, substituting (D) and (B) in {€), 


in 


niffdt 

Ml 

<rd{\/ni 


and, multiplying through by ■\/ni, t-\^ni = Sdi/<rd,. 

Thus we have the paired differences in “standard (2) scores” 
taken from zero as origin. If now we use the symbol 2 for the.so 
scores and sum for all the cxporimoni.s, wo have TiMu =* Si\/n, 
it being thus indicated that each t is to bo weighted by the square 
root of its corresponding n. If wo assume that these deviations 
divided by the standard deviations of their respecitive series are 
sufficiently similar to permit averaging them withoiit distortion 
of meaning, the difference between the moans of the summed 
experimental and control groups will bo the same as the mean 
of all the paired differences; viz., 


The { for this set of combined z scores will bo, by analogy with 

c^-), 


tt = 



<r.,M 


(230) 


where now the is the standard deviation of the whole con- 

solidated population of paired differences. If the Zi', were taken 
as deviations from the true mean instead of from zero and if the 
2 scores were standard scores from the total population instead 
of from the subgroups, this <r,^ would be 1 , which is always the 

value of the standard deviation of a set of 2 scores. This latter 
condition need not worry us, since the sigma of a standard-error 
formula is properly that of the total population of samples 
rather than that of a single sample. The former condition 
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operates only to add a constant to all scores, whicli does not 
affect the variability. Thus the standard deviation is sub- 
stantially 1, and (230) simplifies to 


(H) 


. Si-v/n 

H = — ;=- 
V 


This would lend itself to calculation if we had the several 
ratios and the several populations. If we may assume sub- 
stantially equal populations in the several samples, our formula 
further simplifies as follows : 


tt = 


■ y/ n 

Sn’ “1 


2)^ — 

“ 7 ^ ■ V^V wVo = MtVa (230o) 

Ufu 


Thus, if the samples are assumed to be equal in size of popula- 
tion and equally potent in contributing to a validly measured 
difference, the ratio between the total mean difference and its 
standard error may be taken to be substantially the square root 
of the number of samples times the mean ratio. Thus from 25 
determinations the standard-error ratio may be expected to be 
five times as great as the average ratio from a single determination. 

The formulas of this section, just as those of the following 
sections, are not offered as useful formulas for actually making 
a quantitative computation of the correct statistic; the assump- 
tions which must be made are too precarious to make that safe, 
except as a rough estimate. The argument is intended merely 
to stress tho fact that the reliability of a set of experiments with 
difforence.s prevailingly in the same direction is much higher 
than that of the average single trial. But it must be noted that 
this applies only where the populations of the several experiments 
are independent of one another; it does not apply with full force 
to the case where the same pupils are remeasured, but only 
where there are added chance samples of the total population 
regarding which the generalization is to be stated. 

One of the authors^ has shown elsewhere that summing together 
subtests, as when the experimenter gives a test at the end of 
each of a number of units in the course of the experiment and 
then sums the scores into totals in addition to making separate 

> PsTBBS, C. C., "InoreaSing Reliability in ControUed Experiments,” 
J. Bdua, Vol. 80, pp. 143-160. 
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showings, also increases the reliability of the experiment. Apart 
from the question of fatigue, the same effect would be achieved 
by very extensive tests at the close of the experiment. If the 
pofred differences in a matched-group experiment correlate zero 
among the subtests, which is rather likely to bo the case, the fol- 
lowing formula indicates the manner in which t may bo expected 
to respond to summing together a comparable teats as compared 
with the t from a single test: 

t, = Wa ( 231 ) 

where t, is the ratio of the difference to its standard error for 
the summed scores, U is that of a single tost, and a is the number 
of tests. This indicates tremendous gains in reliability from 
extensive testing. 


VALID MEASUREMENTS 

The previous section was directed against the practice of using 
short and meager tests for measuring outcomes of experimenta- 
tion and small populations. In this section we shall show the 
influence of validity of measurement in separating the means. 
Unfortunately it often, happens in experimentation that com- 
mercial tests are employed to measure outeomos because they 
have prestige or because they are readily available, when they 
are not very closely related to the difference the experimental 
factor could be expected to make. That is, they may be valid 
for other purposes but not particularly valid for measuring the 
outcomes of the particular experiment in question. We shall 
show that the difference between measured outcomes in experi- 
mental and control groups is likely to be attenuated by reason 
of this lack of validity in the testing instrument. 

Let c stand for the elements which a test measures that are 
affected by the experimental factor, let b stand for other identifi- 
able elements validly measured as some kind of performance 
but not a performance affected by the experimental factor, and 
let e be chance factors caught in the measures. The teet is, then, 
valid for its purpose to the extent to which it meiMurw only th® 
c factors. Each individual’s soqre will be made up ® + b +■ e 
factors. Ihe difference between the means will be iittle affected 
by the b or the e factors, sdn.ee they will tendltp 
the same on the 
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variability will be affected by the b and the e factors as well as 
by the c factors; it will be increased by reason of them. 

If the test were perfectly valid, the difference, measured in 
standard scores, would bo D/<rc, while with an invalid test it is 
D/<r(c+b^->i}- This latter is <Tc/<yic-n+ii) times as great as the former. 
But (ro/<r(c+?, 4 .„) = which is the validity coefficient of the 

test — the correlation between its scores and perfectly valid scores 
of the same function. The proof of that is as follows: Consider 
our measures of c, b, and o to be in the form of deviations from 
the means of their respective arrays. Then 

_ Sc^ + Sc6 + See 

ly(rc(r(c+h+e) 

But, since b and e are uncorrelated with c, Sc5 and See equal 
zero. Taking the N with the Sc* of the numerator, we have 

„ _ <^0 _ o-c 

»c(c+6-fe) — — 

O' cO* (c4-64.<j) cr (c-{.&4.e) 

If Dt represents the difference when validly measured and D 
the difference obtained by the somewhat invalid test, we have, 
from the last sentence preceding the proof, I> = rPt, orD, = D/r. 
Thus the difference would be separated if validly measured to an 
amount equal to the obtained difference divided by the validity 
coefficient of the test for measuring the particular function dif- 
ferentiating between the experimental and the control processes, 
when we are talking in terms of standard scores. This will 
operate to raise the standard-error ratio since the o- of the 
denominator, which has been decreased by elimination of the 
irrelevant elements from the test, is the one which appears in 
the standard-error formula. 

The validity coefficient we are talking about here has nothing 
to do with the validity coefficients often published by test 
makers, which are correlations with scores from other trusted 
tests measuring presumably the same function. We mean by 
tlie validity coefficient the coefficient of correlation between scores 
containing no factors other than relevant ones and corresponding 
scores containing some such factors — an r that could hsive, 
under ordinary testing conditions, only a theoretical meaning but 
about which it is, nevertheless, Ulumiaating to speculate. 
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Of course, in practice wo could not ordinarily make this correc- 
tion quantitatively, because wo do not know the validity coeffi- 
cient of the test for the purpose in hand. But this argument 
shows the danger involved in employing testing instruments in 
experimentation which have little pertinency to the experimental 
factor and do little justice to it, then taking seriously tihe small 
and unreliable differences thus obtained. This vciry often hap- 
pens in practice. It is not improbable that tests are sometimes 
employed for measuring outcomes in cxperimentat.ion which 
are padded out by 90 per cent of irrelevant eU'ments while 
failing to include another 90 per cent of the out.(!omes aei.ually 
influenced by the experimental factor. Under these conditions 
the real differeirco would bo ten times as great (in standard terms) 
as the obtained one. 


A SIGNIFICANT RATIO 

Finally, we must again protest the magic that is involved, 
chiefly for laymen in statistics, in a ratio of just 3 between a 
difference and its standard error. This is complet(^ly arbi- 
trary. Several other equally arbitrary ratios have been suggested. 
Fisher proposes 2, while McCall has obtained wide use of 2.78. 
All these ratios, except perhaps Fisher’s, arc higher than are 
usually attainable in experiments in education and the social 
sciences. If one looks through the experimental literature in 
these fields, he will find that by those standards the vast majority 
of experiments turn out to show differences that are “not 
statistically significant,” That would be harmlass enough 
if such outcome were not so frequently misinterpreted. It is 
often taken to moan that the two procedures are equal in value 
while the experiment may indicate odds of 10 to 1, or 100 to 1, 
or even 600 to 1 that one is superior to the other. Under such 
circumstances the evidence does not mean that the procedures 
are probably of equal effectiveness but only that it has not yet 
been condusively proved that A is better than B. We should like 
to bet on the stock market with the odds 100 to 1 in our favor, or 
even 5 to 1 ; and in the same spirit we are willing to consider with 
more favor than wo accord its rival a procedure that an experi- 
ment indicates to be superior by odds of much less than the 
740 to 1 that a ratio of 3 indicates, while we await more conclusive 
evidence. 



TECHNIQUE OF CONTROLLED EXPERIMENTATION 477 

In order to make this objection somewhat more tangible, we 
might tentatively suggest another particular ratio— if we could 
feel guaranteed that it, too, would not be taken as magic. If 
the reader will examine the shape of a normal curve, he will find 
a place where the curve bends to a maximum degree in thinning 
out the distribution into a long tail. This point, as one can 
easily determine by placing the third derivative of the normal- 
curve function equal to zero and solving for x, is ^/3 sigmas from 
the moan; that is, 1.73cr. We suggest that this might be taken 
as a standard for provisional acceptance of the findings of an 
experiment, and we propose that it might be named the working 
ratio* This point of maximum deflection is the place where the 
tail begins most radically to thin and hence where the odds 
begin to increase extremely rapidly with added x distances. Of 
course, that docs not really make it any less arbitrary as a 
standard; but that ratio represents odds of 23 to 1, and those 
would seem to be high enough to gamble on while we seek more 
conclusive evidence. 


Exercises 

1* Work up Beaglo^s experiment (page 458) in a number of ways. Of 
course, the poptilation here is too small to justify elaborate statistical 
manipulation, but the data are presexited because the scores are so small as 
to involve a minimum of penciling, and they will do well enough for practice. 

a. Find the difference between the means of gains for the two groups and 
tho reliability of that difference, 

h. These groups were matched on general intelligence test scores. Al- 
though these scores are not given here, the pairs are ranked in descending 
order on the basis of them. Compute p between this general intelligence 
criterion and initial scores in appreciation of literature. On the basis of this 
finding criticise the use of general intelligence test scores as a matching 
basis in this experiment. 

c. Compare the groups on the basis of merely end scores. Does this 
comparison toll the same story as that told by gains? Which tells the safer 
story? 

dL In which group do final scores correlate more highly with initial scores? 
What is the importance of that, if any? 

e. How do gains correlate with initial scores? With the matching ele- 
ment? Compare with formulas (223) and (224), page 461. 

/• What correlation is there between gains in the experimental and in the 
control group? Compare with page 469, 

g* Try the difference method of correlation on Exercise e [formula (44), 
pi^ 1011, and oompare its findmgs and its oonvenienoe with the usual 
pr^uct formula* 
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k. Compare the variability of gains in the experimental group with that 
in the control group, and interpret results. 

1. The Abbott-Trabue test has rather low reliability for this age level. 
What effect has that on the findings? You have from these exercises 
information on the reliability of this measure for these groups. Find it. 

2. Examine the write-ups of experiments in doctors^ and mastc^rs^ theses, 
and in journals, and compare their techniques with the recommendations 
of this chapter. 

3. If you wish to do Exercise 2 more systematically, make a score card for 
experimental technique, and with it systematically evaluate the t<Kdvniq\ies 
employed in a wide sampling of experiments in education, psychology, and 
the social sciences. 
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XLIII. — Normal Probability Integral Oriented in Terms of q 


x/<rs 

z 

0.0000 

.3989 

0.0026 

.3989 

0.0050 

.3989 

0.0076 

.3989 

0.0100 

.3989 

0.0126 

.3989 

0.0160 

.3989 

0.0176 

.3989 

0.0201 

.3989 

0.0226 

.3988 

0.0251 

.3988 

0.0276 

.3988 

0.0301 

.3988 

0.0326 

.3987 

0.0351 

.3987 

0.0376 

.3987 

0.0401 

,3986 

0,0426 

.3986 

0.0461 

.3986 

0,0476 

.3985 

0.0602 

.3984 

0.0527 

.3984 

0.0662 

.3083 

0.0677 

.3983 

0.0602 

.3982 

0.0627 

.3982 

0.0662 

.3981 

0.0677 

.3980 

0,0702 

,3980 

0.0728 

.3979 

0.0763 

.3978 

0.0778 

,3977 

0,0803 

.3977 

0.0828 

.3976 

0.0853 

.3976 

0.0878 

.3974 

0.0904 

.3973 

0.0929 

.3972 

0.0964 

.3971 

0.0979 

.3970 

0.1004 

.3969 

0,1030 

.8968 

0.1066 

.3967 

O.IOSO 

.8966 

0.1106 

.8965 

0.1130 

.8964 

0.1156 

.8968 

0.1181 

.3962 

0.1206 

.8961 

0.1281 

.8969 


<z 

x/cs 

.450 

0.1257 

.449 

0.1282 

.448 

0.1307 

.447 

0.1332 

.446 

0.1368 

.446 

0.1383 

.444 

0.1408 

.443 

0.1434 

.442 

0.1459 

.441 

0.1484 

.440 

0.1510 

.439 

0.1635 

.438 

0.1560 

.437 

0.1686 

.436 

0.1611 

.436 

0.1637 

.434 

0.1662 

.433 

0.1687 

.432 

0.1713 

.431 

0.1738 

.430 

0.1764 

.429 

0.1789 

.428 

0.1816 

.427 

0.1840 

.426 

0.1866 

.425 

0.1891 

.424 

0.1917 

.423 

0.1942 

.422 

0.1968 

.421 

0.1993 

.420 

0.2019 

.419 ! 

0,2046 

.418 

0.2070 

,417 

0.2096 

.416 

0.2121 

.416 

0.2147 

.414 

0,2173 

.413 

0.2198 

.412 

0.2224 

.411 

0.2250 

.410 

0,2275 

,409 

0.2301 

•408 

0.2827 

,407 

0.2363 

.406 

0.2378 

,405 

0.2404 

.404 

0.2430 

• 403 

0.2456 

.402 

0.2482 

.401 

0.2608 


z 

a 

.3958 

.400 

.3957 

.399 

.3955 

.398 

.3954 

.397 

,3953 

.396 

.3951 

.395 

.3950 

.394 

.3949 

.393 

.3947 

.392 

,3946 

.391 

.3944 

.390 

.3943 

.389 

.3941 

.388 

.3940 

.387 

.3938 

.386 

.3936 

.386 

.3935 

.384 

.3933 

.383 

.3931 

.382 

.3930 

.381 

.3928 

.380 

.3926 

.379 

,3924 

.378 

.3922 

.377 

.3921 

.376 

.3919 

.375 

.3917 

.374 

.3915 

.373 

.3913 

.372 

.3911 

.371 

.3909 

.370 

.3907 

.369 

.3906 

.368 

.3903 

.367 

.3901 

.366 

.3899 

.365 

.3896 

.364 

.3894 

.363 

.3892 

.862 

.3890 

.361 

.8887 

.360 

.3885 

.359 

.3888 

.368 

.8881 

.367 

.3878 

.866 

.3876 

.855 

.3873 

.854 

.3871 

.358 

.8868 

,352 

.3866 

1 .851 


a?/<r» 

z 

0,2533 

.3863 

0 . 2559 

.3861 

0.2585 

.3858 

0,2611 

.3856 

0.2637 

.3853 

0.2663 

.3850 

0.2689 

.3848 

0,2715 

.3845 

0.2741 

.3842 

0.2767 

.3840 

0.2793 

.3837 

0.2819 

.3834 

0.2846 

.3831 

0.2871 

.3828 

0.2898 

.3825 

0.2924 

.3823 

0.2950 

.3820 

0,2976 

.3817 

0.3002 

.3814 

0.3029 

.3811 

0.3066 

.3808 

0.3081 

.3804 

0.3107 

.3801 

0.3134 

3798 

0.3160 

.3796 

0.3186 

,3792 

0.3213 

.3789 

0.3239 

.3786 

0.3266 

.3782 

0.3292 

,3779 

0,3319 

,3776 

0.3345 

.3772 

0.3372 

.8769 

0.3398 

.3766 

0.3426 

3762 

0.3461 

.3769 

0.3478 

.3766 

0.3606 

.3762 

0.3531 

.3748 

0.365S 

.3745 

0.3685 

,3741 

0.36X1 

.3738 

0.3638 

.3734 

0.3665 

.3730 

0.3692 

.3727 

0.3719 

.8723 

0.8745 

.3719 

0.8772 

.3715 

0.8799 

.3712 

i 0.8826 

1 

.8708 
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Table XLIII . — Normal Probability Integral Oriented in Terms of q , 

(Continued) 


Q 

x/crz 



X/ffx 

z 

Q 

x/trm 

z 

.350 

0 3863 

.3704 

,300 

0 5244 

.3477 

250 

0.6746 

.3178 

.349 

0.3880 

.3700 

.299 

0 5273 

.3472 

.249 

0.6776 

.3171 

.348 

0 3907 

.3696 

.298 

0.5302 

.3466 

.248 

0.6808 

.3164 

.347 

0 3934 

.3692 

.297 

0.5330 

.3461 

.247 

0.0840 

,3167 

.346 

0 3961 

.3688 

,296 

0.5359 

.3456 

.246 

0.6871 

.3151 

.345 

0.3989 

.3684 

.295 

0.5388 

.3450 

.246 

0.6003 

.3144 

.344 

0.4016 

.3680 

.294 

0.6417 

.3445 

.244 

0.6935 

.3137 

.343 

0 4043 

.3676 

,293 

0.5446 


.243 

0.6967 

.3130 

.342 

0.4070 

.3672 

.292 

0.5476 

.3434 

.242 

0.6999 

,3123 

341 

0.4097 

.3668 

.291 

0.5506 


.241 

0.7031 

.3116 

.340 

0.4125 

.3664 

.290 

0.5534 


.240 

0.7063 

.3109 

.339 

0,4152 

.3660 

.289 

0.5663 

.3417 


0 7095 

.3102 

.338 

0.4179 

.3666 

.288 

0.5592 

.3412 

.238 

0.7128 

.3095 

.337 

0 4207 

.3652 

.287 

0.5622 

.3406 

.237 

0.7160 

.3087 

.336 

0.4234 

.3647 

.286 

0.5661 

.3401 

.236 

0.7192 

.3080 

.335 

0,4261 

.3643 

.295 

0.6681 

.3395 


0.7226 

.3073 

.334 

0.4289 

.3639 

.284 

0.5710 

.3389 

.234 

0.7267 

.3066 

.333 

0.4316 

.3635 

.283 

0.5740 

.3384 

.233 

0.7290 

.3058 

.332 

0.4344 

.3630 

.282 

0.6769 

.3378 


0.7323 

.3051 

.331 

0.4372 

.3626 

.281 

0.5799 

.3372 

,231 

0.7356 

.3044 

.330 

0.4399 

,3621 

.280 

0.5828 

.3366 

.230 

0.7388 

.3036 

.329 

0.4427 

.3617 

.279 

0.6858 

.3360 


0.7421 

.3029 

.328 

0.4454 

.3613 

.278 

0.6888 

.3355 

.228 

0.7464 

.3022 

.327 

0.4482 

.3608 

.277 

0,6918 

.3349 

.227 

0,7488 

.3014 

.326 

0.4610 

.3604 

,276 

0.6948 

.3343 

.226 

0.7621 

.3007 

.325 

0.4538 

.3699 

.276 

0.6978 

.3337 


0.7654 

.2999 

.324 

0.4565 

.3695 

.274 

0.6008 

.3331 


0.7688 

.2992 

.323 

0.4593 

.3590 

.273 

0.6038 i 

.3326 


0.7621 

.2984 

.322 

0.4621 

.3585 

.272 

0.6068 I 

.3319 

.222 

0.7066 

.2976 

.321 

0.4649 

.3681 

.271 

0.6098 

.3313 

.221 

0.7688 

.2969 

.320 

0.4677 

.3676 

.270 

0.6128 

.3306 

.220 

0.7722 

.2961 

.319 

0.4705 

.3571 

,269 

0.6158 

.3300 

.219 

0.7756 

.2953 

.318 

0.4733 

.3667 

.268 

0.6189 

.8294 

.218 

0.7790 

.2945 

.317 

0.4761 

.3662 

.267 

0.6219 

.3288 

.217 

0.7824 

.2938 

.316 

0.4789 

.3667 

,266 

0.6260 

.3282 

.216 

0.7858 

.2930 

.315 

0.4817 

.3562 

,266 

0.6280 

.3275 

.215 

0.7892 

.2922 

.314 

0.4845 

.3548 

.264 

0.6311 

.8269 

.214 

0.7026 

.2914 

.313 

0.4874 

.3543 

.263 

0.6341 

.3263 

.213 

0.7961 

.2906 

.312 

0.4902 

.3538 

.262 

0.6372 

.3256 

.212 

0.7995 

.2898 

.311 

0.4930 

.3533 

.261 

0.6403 

.8250 

.211 

0.$080 

.2890 

.310 

0.4959 

.3528 

.260 

0.6433 I 

.8244 


0.8064 

.2882 

.309 

0.4987 

.3523 

.259 

0.6464 1 

.8237 

.209 

0.8099 

,2874 

.808 

0.5015 

.3518 

.258 1 

0,6496 

.8231 

.208 

0.8134 

.2866 

.307 

0.5044 

.3613 

.257 

0.6626 

.3224 

.207 

0.8169 

.2858 

.306 

0.6072 

.360$ 

.256 

0.6557 

.3218 

.206 

0.8204 

.2849 

.305 

0.6101 

.3503 

.255 

0.6588 

.8211 

.205 

0.8239 

.2841 

.304 

0.5129 

.3498 

.254 

0.6620 

.3204 

.204 

0.8274 

.2838 

.303 

0.5168 

.3493 

.263 

0.6651 

.8198 

.203 

0.8310 

.2825 

.302 

0.5187 

.3487 

.252 

0.6682 

.8191 

.202 

0.8345 

.2816 

.301 

0.5216 

.3482 

.261 

0.6713 

.8184 

.201 

0.8381 

.2808 
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Table XLIII. — Normal Probability Integral Oriented in Terms op q, 

(Continued) 


a 

flj/o-* 




z 

9 

x/a-n 

z 

.200 

0.8416 

.2800 

.150 

1.0,364 

.2332 

.100 

1.2816 

.1756 

.199 

0 8462 

.2791 

.149 

1.0407 

.2321 

.099 

1.2873 

.1742 

.198 

0.8488 

.2783 

.148 

1.0450 

.2311 

.098 

1.2930 

.1729 

.197 

0.8524 

.2774 

.147 

1.0494 

.2300 

.097 

1.2988 

.1716 

.196 

0.8560 

.2766 

.146 

1.0537 

.2290 

.096 

1.3047 

.1703 

.196 

0.8696 

.2757 

.145 

1.0581 

.2279 

.096 

1.3106 

.1690 

.194 

0.8633 

.2748 

.144 

1.0625 

.2269 

.094 

1.3165 

.1677 

.193 

0.8669 

.2740 

.143 

1.0669 

.2258 

.093 

1.3226 

,1664 

.192 

0.8706 

.2731 

.142 

1.0714 

.2247 

.092 

1.3285 

.1651 

.191 

0.8742 

.2722 

.141 

1.0768 

,2237 

.091 

1.3346 

.1637 

.190 

0.8779 

.2714 

.140 

1.0803 

.2226 

.090 

1.3408 

.1624 

.189 

0.8816 

.2705 

.139 

1.0848 

.2215 

.089 

1.3469 

.1610 

.188 

0.8853 

.2696 

.138 

1.0893 

.2204 

.088 

1.3532 

.1697 

.187 

0.8890 

.2687 

.137 

1.0939 

.2193 

.087 

1.3595 

.1583 

,186 

0.8927 

.2678 

.136 

1.0985 

.2182 

.086 

1.3658 

.1570 

.186 

0.8966 

.2069 

.135 

1.1031 

.2171 

.085 

1.3722 

.1656 

.184 

0.9002 

.2660 

.134 

1.1077 

.2160 

.084 

1.3787 

.1542 

.183 

0.9040 

.2651 

.133 

1.1123 

.2149 

.083 

1.3862 

.1529 

.182 

0.9078 

.2042 

.132 

1.1170 

.2138 

.082 

1.3917 

.1516 

.181 

0.9 U 6 

.2633 

.131 

1.1217 

.2127 

.081 

1 3984 

.1501 

.180 

0.9154 

.2624 

.130 

1.1264 

.2116 

.080 

1.4061 

.1487 

.179 

0.9192 

.2015 

.129 

1.1311 

.2104 

.079 

1.4118 

.1473 

.178 

0 9230 

.2606 

.128 

1.1359 

.2093 

.078 

1.4187 

.1458 

.177 

0.92(59 

.2696 

,127 

1.1407 

.2081 

.077 

1.4265 

.1444 

.176 

0.9307 

.2687 

.126 

1.1456 

.2070 

.076 

1.4326 

.1430 

.176 

0.9346 

,2578 

,125 

1.1603 

,2059 

.076 

1.4395 

.1416 

.174 

0.9386 

.2508 

.124 

1.1552 

.2047 

.074 1 

1.4466 

,1401 

.173 

0.9424 

.2669 

.123 

1.1001 

.2036 

.073 

1.4538 

.1387 

.172 

0.9463 

.2560 

,122 

1.1060 

.2024 

.072 

1.4611 

.1372 

.171 

0.9502 

.2540 

.121 

1.1700 

.2012 

.071 

1.4684 

.1367 

.170 

0.9542 

.2631 

.120 

1.1760 

,2000 

.070 

1.4758 

.1343 

.169 

0.9581 

.2521 

.119 

1.1800 

.1989 

.069 

1.4833 

,1328 

.168 

0.9621 

.2511 

,118 

1.1860 

.1977 

.068 

1.4909 ; 

.1313 

.167 

0.9661 

.2502 

.117 

1.1901 

.1965 

.067 

1.4985 

.1298 

.166 

0.9701 

.2492 

.116 

1.1952 

.1953 

.066 

1,5063 

.1283 

,166 

0.9741 

.2482 

.116 

1.2004 

.1941 

.065 

1.5141 

,1268 

.164 

0.9782 

.2478 

.114 

1.2056 

.1929 

.064 

1.6220 

.1263 

.163 

0.9822 

.2463 

.113 

1.2107 

.1917 

.063 

1.6301 

.1237 

,162 

0.9863 

,2453 

.112 

1.2160 

.1905 

.062 

1.6382 


.161 

0.9904 

.2443 

.111 

1.2212 

.1893 

.061 

1.5464 

.1207 

.160 

0.9945 

.2433 

.110 

1.2265 

.1880 

.060 

1.5548 

.1191 

.169 

0.9986 

.2423 

.109 

1.2319 

.1868 

.069 

1.6632 

.1176 

.158 

1,0027 

.2413 

.108 

1.2872 

.1866 

.058 

1.6718 

.1160 

.157 

1.0069 

.2408 

.107 

1.2426 

.1843' 

,067 

1.6805 

.1144 

.156 

l.OllO 

.2393 

.106 

1.2481 

.1831 

,066 

1.6893 

.1128 

.155 

1.0152 

.2883 

.106 i 

1.2636 

.1818 

.065 

X .5982 

.1112 

.164 

1.0194 

.2873 

.104 

1.2591 

.1806 

.054 

1.6072 

,1096 

.153 

1.0287 

.2862 

.103 

1.2646 

.1793 

.063 

1.6164 

.1080 

.162 

1.0279 

.2352 

.102 

1,2702 

.1781 

.052 

1.6268 

,1064 

.161 

1.0322 

.2842 

.101 

1.2759 

.1768 

.061 

1.6352 

.1048 
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Table XLIII. — Normal Probability Integral Oriented in Terms of 

(Concluded) 


ff 

x/<rx 

z 

Q 

x/ffx 

z 

0 

x/vx 

z 

.060 

1 6449 



1 8384 

.0736 

.016 

2.1444 

.0400 

.049 

1.6546 


032 

1.8522 

.0718 

.015 

2.1701 

.0379 

.048 

1 . 6646 



1.8663 

.0699 

.014 

2.1973 

.0367 

.047 

1 6747 

.0982 

030 

1 . 8808 


.013 

2.2262 

0335 

.046 

1.6849 

.0965 


1.8957 


012 

2.2671 

.0312 

.045 

1.6954 

.0948 


1.9110 

,0643 

.011 

2.2904 

.0200 

.044 

1.7060 

.0931 


1.9268 

.0623 

.010 

2.3263 

.0267 

.043 

1 7169 

.0914 


1.9431 


.009 

2.3656 

.0243 

.042 

1.7279 

.0897 

.025 

1.9600 

,0584 

.008 

2.4089 

.0219 

.041 

1.7392 

.0879 

.024 

1.9774 

.0666 

.007 

2.4573 

.0196 

.040 

1.7507 

.0862 


1.9954 

.0545 

.006 

2.6121 

.0170 

.039 

1.7624 

.0844 

.022 

2.0141 

.0626 

.005 

2.6768 

.0146 

.038 

1.7744 

.0826 

.021 

2.0335 

.0506 

.004 

2.6521 

.0118 


1.7866 

.0809 

.020 

2,0537 

.0484 

.003 

2.7478 

.0091 

.036 

1.7991 



2.0749 

.0464 

.002 

2.8782 

.0063 

.035 

1.8119 

.0773 

.018 

2,0969 

.0443 

.001 

3.0002 

.0034 

.034 

1.8260 

.0766 

.017 

2.1201 

.0422 





♦ The abave table was adapted from the table by Kondo and Elderton, published in 
Siometrika, Vol. 22, pp. 368-*376. The following table (Table XHV) was adapted from 
Peexson.*s '‘Tables for Statistioiana and Biometiioians." Both tables are used by arrange- 
ments with the publishers through Prof. E. S. Pearson, editor of Siomeirika. 
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Table XLIV. — Normal Probability Integral, Oriented in Terms of 


x/<rx 

.50^ 

z 

X/1TX 

.50-3 

z 

x/ax 

.50-3 

z 

0.00 

.0000 

.3989 

0.50 

.1915 

.3521 

1.00 

.3413 

.2420 

0.01 

.0040 

.3989 

0 51 

.1950 

.3503 

1.01 

.3438 

,2396 

0.02 

.0080 

.3989 

0 52 

.1985 

.3485 

1.02 

3461 

.2371 

0 03 

,0120 

.3988 

0.53 

.2010 

.3467 

1.03 

.3485 

.2347 

0.04 

.0160 

.3986 

0.54 

.2054 

.3448 

1.04 

.3508 

.2323 

0.05 

0109 

.,3984 

0,55 

.2088 

.3429 

1 05 

.3531 

2299 

0 06 

,0239 

.3982 

0.66 

.2123 

.3410 

1.06 

.3554 

2275 

0.07 

.0279 

.3980 

0.57 

,2157 

.3391 

1.07 

3677 

.2251 

,0.08 

.0319 

.3977 

0.58 

.2190 

.3372 

1.08 

.3599 

.2227 

0.00 

.0359 

.3973 

0.59 

.2224 

.3352 

1 09 

.3621 

.2203 

0.10 

.0398 

.3970 

0.60 

.2257 

.3332 

1.10 

3643 

.2179 

0.11 

.0438 

.3965 

0.61 

.2291 

.3312 

1.11 

.3665 

.2155 

0.12 

.0478 

.3901 

0.62 

.2324 

.3292 

1.12 

.3686 

2131 

0.13 

.0517 

.3956 


.2357 

.3271 

1.13 

.3708 

.2107 

0.14 

.05.57 

.3951 

0.64 

.2389 

.3251 

1.14 

.3729 

.2083 

0.15 

.0596 

.3945 


.2422 

.3230 

1.15 

.3749 

2059 

0.10 

.0636 

.3939 

0.06 

.2454 

.3209 

1.16 

.3770 

.2036 

0.17 

.0675 

.3932 

0.07 

.2486 

.3187 

1.17 

.3790 

.2012 

0.18 

.0714 

.3925 

0.68 

.2517 

.3160 

1 18 

.3810 

.1989 

0.19 

.0753 

.3918 

0.09 

.2549 

.3144 

1.19 

.3830 

.1965 

0.20 

.0793 

.3910 


.2580 

.3123 

1.20 

.3849 

.1942 

0.21 

.0832 

.3902 

0.71 

.2611 

.3101 

1,21 

.3869 

.1919 

0.22 

.0871 

.3894 

0.72 

.2642 

.3079 

1.22 

.3888 

1896 

0.23 

.0910 

.3885 

0.73 

.2673 

.3066 

1.23 

.3907 

.1872 

0,24 

.0948 

.3876 

0.74 

.2704 

.3034 

1.24 

.3925 

.1849 

0.25 

.0087 

.3807 

0.75 

.2734 

.3011 

1.26 

.3944 

.1826 

0.26 

.1026 

.3857 

0.76 

.2764 

.2989 

1.26 

.3962 

.1804 

0.27 

.1064 

.3847 

0,77 

.2794 

.2966 

1.27 

.3980 

.1781 

0.28 

.1103 

f .3836 

0.78 

.2823 

.2943 

1.28 

.3997 

.1768 

0.29 

.1141 

1 .3825 

0.79 

.2862 

.2920 

1.29 

.4015 

.1736 

0.30 

.1379 

.3814 


,2881 

.2897 

1.30 

.4032 

.1714 

0.31 

.1217' 

.3802 

0,81 

.2910 

.2874 

1.31 

.4049 

.1691 

0.32 

.1255 

.3790 

0.82 

.2938 

.2850 

1.32 

.4066 

.1669 

0.33 

.1293 

! .3778 

0.83 

.2967 

.2827 

1.33 

.4082 

.1647 

0.34 

.1331 

.3765 

0.84 

! .2996 

.2803 

1.34 

.4099 

.1626 

0.36 

1 .1308 

.3752 

0.86 

.3023 

.2780 

1.36 

.4115 

.1604 

0,36 

1 .1406 

,3739 

0.86 

,3061 

.2756 

1.36 

.4131 

.1682 

0.37 

.1443 

.3725 

0.87 

.3078 

.2732 

1.37 

.4147 

.1661 

0.88 

.1480 

.3712 

0.88 

.3106 

.2709 

! 1.38 

.4162 

.1539 

0.39 

,1617 

.3697 

0.89 

.3133 

.2685 

1.39 

.4177 

.1618 

0.40 

.1554 

.3683 

0.90 

.3159 

.2661 

1.40 

.4192 

.1497 

0.41 

1 .1591 

.3668 

0.91 

.3186 

.2637 1 

1,41 

.4207 

,1476 

0.42 

I .1628 

.3653 

0.92 

.3212 

.2613 1 

1.42 

.4222 

.1466 

0.43 

.1664 

.3637 

0.93 

.3238 

.2589 

1.43 

.4236 

.1486 

0,44 

t .1700 

.3621 

0.94 

.3264 

.2566 

1.44 

.4251 

.1415 

0,45 

.1736 

.3605 

0,95 

.3289 

.2541 

1.46 

.4265 

.1394 

0.46 

.1772 

.3589 

0.96 

,3315 

.25 X 6 

1.46 

.4279 

4374 

0,47 

.1808 

.3672 

mSm 

.3340 

.2492 

1.47 

.4292 

.1354 

0.48 

,1844 

.3555 


.8365 

.2468 

1,48 

.4306 

.1334 

0.49 

. 1879 

.3538 


.3389 

j .2444 

1.49 

.4319 

4315 
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Table XLIV. — ^Normal Probability Integral, Oriented in Terms of 

a/<r*. — ( Contimted ) 
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Table XLIV. — Nokmal Peob ability Integral, Oriented in Terms of 

ic/cTx. * — {Concluded) 


(Prefix in each column the digits indicated iu parentheses.) 


x/va 

.50-3 

piOH 

x/a-x 

,50-^ 



.50-5 

* 


(.49) 



(.499) 


1 ar/o-x 

(.499) 

BHEHtW 

3.00 

8650 

4432 

3.50 

7674 

8727 


9683 

1338 

3.01 

8694 

4301 

3.51 

7759 

8426 

4.01 

9696 

1286 

3.02 

8736 

4173 

3.52 

7842 

8135 

4.02 

9709 

1235 

3.03 

8777 

4049 

3.53 

7922 

7853 

4.03 

9721 

1186 

3.04 

8817 

3928 

3.54 

7999 

7581 

4 04 


1140 

3,06 

8856 

3810 

3 55 

8074 

7317 

4 05 

9744 

1094 

3.00 

8893 

3695 

3.50 

8146 

7001 

4.00 

9755 

1051 

3.07 

8930 

3584 

3.57 

8215 

6814 

4.07 

9765 

1009 

3.08 

8905 

3476 

3.58 

8282 

6575 

4.08 

9775 

0969 

3.09 

8999 

3370 

3.59 

8347 

0343 

4.09 


0930 

3.10 


3267 


8409 

6119 

4.10 

0793 

0893 

3.11 


3167 


8400 

6902 

4 11 

9802 

0857 

3.12 


3070 


8527 

5693 

4 12 

9811 

0822 

3,13 

9120 

2975 

3.03 

8,583 

5490 

4.13 

9819 

0789 

3.14 


2884 

3.64 


5294 

4.14 

9826 

0757 

3.15 

9184 

2794 

3.65 

8689 

5105 

4.15 

9834 


3.16 

9211 

2708 

3.06 

8739 

4921 

4 16 

9841 

0697 

3.17 

9238 

2623 

3.67 

8787 

4744 

4 17 

9848 

0668 

3.18 

9264 

2541 

3.68 

8834 

4573 

4 18 

9854 

0641 

3.19 

9289 

2462 

3,69 

8879 

4408 

4.19 

0861 


3.20 


2384 

3.70 

8922 

4248 

4.20 

9867 

0589 

3.21 

9336 


3.71 

8064 

4093 

4.21 

9872 

0565 

3.22 

9359 

2236 

3.72 

9004 

3944 

4 22 

0878 

0542 

3.23 

9381 

2165 

3.73 


3800 

4.23 

9883 

0619 

3.24 

9402 


3.74 


3601 

4.24 

9888 

0408 

3.25 



3.75 



4 25 

9893 

0477 

3.26 

9443 


3,76 

9160 

3396 

4.20 

9898 

0457 

3.27 


1901 

3.77 

9184 

3271 

4.27 

9902 

0438 

3.28 

9481 

1840 

3.78 

9210 

3149 

4.28 


0420 

8.29 


1780 

3.79 

9247 

3032 

4.29 

9911 


3.80 

9617 

1723 

3.80 

9277 

2919 

4.30 


0386 

3.31 


1667 

3.81 


2810 

4.31 

0918 

0369 

3.32 

9550 

1612 

3.82 


2705 

4.32 


0354 

3.33 

9560 

mm 

3.83 



4.83 

9926 

0339 

3.34 

9681 

mm. 

3.84 

9385 


4.34 

9929 

0324 

3.36 

9696 

1459 1 

3.85 


2411 

4.35 


0310 

8.36 

9610 


3.86 

9433 

2320 

4.36 

9935 

0297 

3.37 

9024 

1364 

3.87 

9456 

2232 

4.37 

9938 

0284 

8.38 

9638 

1319 

3.88 


2147 

4.38 

9941 

0272 

3.39 

9651 

1276 

3.89 

9499 

2006 

4.39 

9943 

0261 

8.40 

9663 

1232 


.9619 

1987 

4.40 

9946 

0249 

8.41 

9676 

1191 

3.91 

9639 

1910 

4.45 

9967 


8.42 

9687 

1151 


9667 

1837 

4.50 

9066 


3.43 

9698 

1112 

3.93 



4.55 

9973 

0127 

3.44 

9709 

1076 

3.94 

9593 

1698 




8.46 

9720 


3.96 

9609 


4.65 

9983 

0080 

3.46 

9730 

1003 

3.96 

9625 

1669 

4,70 

9987 

0064 

3.47 

9740 

0969 

3.97 

9641 

1508 

4.80 

9992 

0040 

3.48 

9r4t> 

0986 

3,98 

9655 

1449 

4.90 

9996 

0024 

3.49 

9769 

0904 

3.99 

9670 

1303 


9997 

0016 


* See footnote on p. 484* 
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Table XLV. — ^The Distkibxjtion of Student’s i 


(Percentage of the Total Area in Tail of Distribution from t = s/o-, to ») 



HI 

B 

B 


5 

6 

6 

7 

7 

8 

8 

9 

9 

10 

10 

11 

0 

.5000 

.5000 

iSOOO 

.5000 

.5000 

.5000 

.5000 

.5000 

.5000 

.5000 

0.1 

.4683 

.4647 

.4633 

,4626 

.4621 

.4618 

.4616 

.4614 

.4613 

.4612 

0.2 

.4372 

.4300 

.4271 

.4256 

.4247 

.4240 

.4236 

4232 

.4230 

.4227 

0.3 

.4072 

.3962 

.3919 

,3896 

.3881 

.3871 

.3864 

.3859 

.3865 

.3852 

0.4 

.3789 

.3639 

.3580 

3548 

.3528 

.3515 

.3505 

.3498 

.3492 

.3488 

0.5 

.3524 

.3333 

.3257 

.3217 

.3191 

.3174 

.3162 

.3153 

.3145 

.3139 

0.6 

.3280 

.3047 

.2954 

.2904 

.2873 

.2852 

.2837 

.2826 

.2817 

.2809 

0 7 

.3056 

,2782 

.2672 

.2613 

.2576 

.2551 

.2533 

.2519 

.2608 

.2499 

0.8 

.2852 

.2538 

.2411 

.2342 

.2300 

.2271 

.2250 

.2234 

.2222 

.2212 

0.9 

.2667 

.2316 

.2172 

.2095 

.2047 

.2014 

.1990 

.1972 

.1958 

.1946 

1.0 

2500 

.2113 

.1955 

.1870 

.1816 

.1780 

.1753 

.1733 

.1717 

.1704 

1.1 

.2349 

.1930 

.1758 

.1665 

.1607 

.1567 

.1539 

.1517 

.1499 

.1486 

1.2 

.2211 

,1765 

.1581 

.1482 

.1419 

.1377 

.1346 

.1322 

.1304 

.1289 

1.3 

.2087 

.1616 

.1422 

.1317 

.1252 

.1207 

.1174 

.1149 

.1130 

.1114 

1.4 

.1974 

.1482 

.1280 

.1171 

.1102 

.1055 

.1021 

.0995 

.0975 

.0969 

1 . 5 " 

,1872 

.1362 

.1153 

.1040 

.0970 

.0921 

.0886 

.0860 

.0839 

.0823 

1.6 

.1778 

.1254 

.1040 

.0924 

,0852 

.0804 

.0768 

.0741 

.0720 

.0703 

1 7 

.1693 

.1166 

.0938 

.0822 

0749 

.0700 

.0665 

.0638 

.0617 

.0600 

1.8 

.1614 

.1068 

.0848 

.0731 

.0659 

.0610 

.0574 

.0548 

.0527 

.0610 

1.9 

.1542 

.0989 

.0768 

.0651 

.0579 

.0531 

.0496 

.0470 

.0449 

.0433 

2.0 

.1476 

.0918 

.0697 

.0581 

.0510 

.0402 

.0428 

.0403 

.0383 

.0367 

2.1 

.1415 

.0853 

.0633 

.0518 

.0449 

M 02 

. 0369 

.0345 

,0320 

.0310 

2.2 

.1358 

.0794 

.0576 

.0463 

.0395 

.0351 

.0319 

.0295 

.0277 

.0262 

2.3 

,1305 

.0741 

.0525 

.0415 

.0349 

.0306 

.0275 

.0252 

.0235 

.0221 

2.4 

.1257 

.0692 

.0479 

.0372 

.0308 

.0260 

.0237 

.0216 

.0199 

.0187 

2.5 

.1211 

.0648 

.0439 

.0334 

.0272 

.0233 

.0205 

.0186 

.0169 

.0167 

2.6 

,1169 

.0608 

.0402 

.0300 

.0242 

.0203 

,0177 

.0158 

.0144 

.0132 

2.7 

,1129 

.0571 

.0369 

.0270 

.0214 

.0178 

.0153 

.0136 

.0122 

.0112 

2.8 

.1092 

.0537 

.0339 

.0244 

.0190 

.0166 

,0133 

.0116 

.0104 

.0094 

2.9 

.1067 

.0506 

.0313 

,0221 

.0169 

.0137 

.0116 

.0099 

.0088 

,0079 

3.0 

.1024 

.0477 

.0288 

.0200 

.0150 

.0120 

,0100 

.0085 

.0075 

.0067 

3.1 

.0993 

.0451 

.0266 

.0181 

.0134 

.0106 

.0087 

.0073 

.0064 

.0056 

3.2 

.0964 

.0427 

.0247 

.0166 

.0120 

.0093 

.0075 

,0063 

.0054 

.0047 

3.3 

.0937 

.0404 

.0229 

.0150 

.0107 

,0082 

.0066 

),0054 

.0046 

.0040 

3.4 

.0911 

.0383 

.0212 

.0136 

.0096 

.0072 

.0067 

.0047 

.0039 

.0034 
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STATISTICAL PROCEDURES 


Table XLV. — ^Thb Disteibotion oe Sttjdent’s i. — iConMntied ) 


i 

n — 1 
w ' - 2 

2 

3 

3 

4 


5 

6 

6 

7 

00 

8 

9 


10 

11 

3.5 

.0886 

,0364 

.0197 

.0124 

.0086 

.0064 

.0050 

.0040 

.0034 

.0029 

3,6 

1 0862 

.0346 

.0184 

.0114 

.0078 

.0057 

,0044 

.0035 

.0029 

.0024 

3.7 

.0840 

.0330 

.0171 

.0104 

.0070 

.0050 

.0038 

.0030 

.0025 

.0021 

3.8 

.0819 

0314 

.0160 

0096 

.0063 

.0045 

.0034 

.0026 

.0021 

0017 

3.9 

.0799 

.0299 

.0150 

.0088 

.0057 

.0040 

.0029 

.0023 

.0018 

.0015 

4.0 

.0780 

0286 

.0140 

.0081 

.0052 

.0036 

.0026 

.0020 

.0016 

.0013 

4.1 

.0761 

0273 

.0131 

.0074 

.0047 

.0032 

.0023 

.0017 

.0013 

.0011 

4.2 

.0744 

0261 

.0123 

.0068 

.0042 

.0028 

0020 

0015 

.0012 

.0009 

4.3 

.0727 

0250 

.0116 

.0063 

0039 

.0025 

.0018 

.0013 

.0010 

.0008 

4.4 

.0711 

.0240 

.0109 

.0058 

,0035 

.0023 

.0016 

.0011 

.0009 

.0007 

4.5 

.0696 

.0230 

.0102 

.0054 

.0032 

.0021 

i 

.0014 

.0010 

.0007 

.0006 

4.6 

.0681 

0221 

.0097 

.0050 

.0029 

.0018 

.0012 

.0009 

.0006 

.0005 

4.7 

.0667 

.0212 

0091 

0047 

.0027 

.0017 

.0011 

.0008 

.0006 

.0004 

4.8 

.0654 

.0204 

0086 

.0043 

.0024 

.0015 

.0010 

.0007 

.0005 

.0004 

4.9 

.0641 

.0196 

.0081 

.0040 

.0022 

.0014 

.0009 

.0006 

.0004 

.0003 

5.0 

.0623 

.0189 

.0077 

.0037 

.0021 

.0012 

.0008^ 

.0005 

.0004 

.0003 

5.1 

.0616 

.0182 

.0073 

.0035 

.0019 

.0011 

.0007 

.0005 

.0003 

.0002 

5,2 

.0606 

0176 

.0069 

.0033^ 

.0017 j 

.0010 

.0006 

.0004 

,0003 

.0002 

5.3 

.0594 

.0169 

.0066 

.0030 

.0016 

.0009 

.0006 

.0004 

.0002 

0002 

6.4 

‘.0583 

.0163 

.0062 

.0028 

.0015 

.0008 

.0006 

.0003 

.0002 

.0002 

6.5 

.0572 

.0158' 

.0069 

.0027 

.0014 

.0008 

.0005 

.0003 

,0002 

.0001 

6.6 

.0562 

.0152 

.0056 

.0025 

.0013 

.0007 

.0004 

.0003 

.0002 

.0001 

6.7 

.0553 

.0147 

.0054 

.0023 

.0012 

.0006 

.0004 

.0002 

.0001 

.0001 

6.8 

.0543 

.0142 

.0051 

.0022 

.0011 

.0006 

.0003 

.0002 

.0001 

.0001 

6.9 

.0534 

0138 

.0049 

.0021 

.0010 

.0005 

.0003 

.0002 

.0001 

.0001 

6.0 

.0526 

.0133 
1 

.0046 

.0019 

.0009 

.0005 

1 

.0003 

.0002 

,0001 

.0001 


APPENDIX 


491 


Table XLV. — ^Thb Distribution op Student’s t. — [Continued) 


B 


1 

H 


B 

■ 

17 

18 

18 

19 

19 

20 

20 

21 

QO 

3.5 

.0025 

.0022 

,0020 

,0018 

.0016 

.0015 

.0014 

.0013 

0012 

.0011 

0002326 

3.6 

.0021 

.0018 

.0016 

.0014 

.0013 

.0012 

.0011 

.0010 

0010 

.0009 

0001591 

3.7 

.0018 

.0015 

.0013 

0012 

0011 

0010 

0009 

0008 

0008 

.0007 

.0001078 

3.8 

.0015 

.0013 

.0011 

.0010 

.0009 

.0008 

0007 

.0007 

0006 

.0006 

0000723 

3.9 

.0012 

.0011 

.0009 

0008 

.0007 

0006 

0006 

0005 

0005 

0004 

0000481 

4.0 

.0010 

.0009 

.0008 

.0007 

0006 

.0005 

.0005 

.0004 

0004 

.0004 

.0000317 

4.1 

,0009 

.0007 

.0006 

.0005 

.0005 

.0004 

.0004 

.0003 

.0003 

0003 

.0000207 

4.2 

0007 

.0006 

.0005 

.0004 

0004 

.0003 

.0003 

.0003 

0002 

.0002 

.0000133 

4.3 

.0006 

.0005 

.0004 

.0004 

.0003 

.0003 

.0002 

0002 

0002 

.0002 

0000085 

4.4 

.0005 

0004 

0004 

.0003 

.0003 

.0002 

,0002 

.0002 

.0002 

0001 

0000054 

4.5 

.0005 

.0004 

^ 0003 

.0002 

.0002 

.0002 

.0002 

.0001 

.0001 

.0001 

.0000034 

4.6 

.0004 

.0003 

.0002 

0002 

.0002 

0001 

OOOT 

0001 

0001 

0001 

.0000021 

4.7 

.0003 

.0003 

.0002 

.0002 

.0001 

0001 

.0001 

.0001 

.0001 

.0001 

0000013 

4.8 

0003 

,0002 

.0001 

.0001 

.0001 

.0001 

.0001 

0001 

.0001 

.0001 

0000008 

4.9 

.0002 

0002 

.0001 

.0001 

.0001 

.0001 

.0001 

.0001 

0000 

.0000 

.0000005 

5.0 

.0002 

.0002 

.0001 

.0001 

.0001 

0001 

.0001 

0000 



.0000003 

6.1 

.0002 

.0001 

.0001 

.0001 

.0001 

.0001 

.0000 

.0000 



.0000002 

6.2 

.0001 

.0001 

.0001 

.0001 

.0001 

.0000 





0000001 

5.3 

.0001 

.0001 

.0001 

.0001 

.0000 






.0000001 

5.4 

.0001 

.0001 

,0001 

.0000 







.0000000 

5.5 

.0001 

0001 

,0001 









6.6 

.0001 

,0001 

.0000 









5.7 

.0001 

0000 










6.8 

.0001 











6.9 

.0001 











6.0 

.0000 
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Table XLV. — ^The Distbibction of Student’s t.* — (Conduded) 


i 

■ 



6 

7 

7 

8 

8 

9 

9 

10 

10 

11 

6,0 

.004636 

,001941' 

.000923 

000482 

000271 

000162 

,000101 

.000066 

6.5 

,003697 

.0014451 

.000643 

000316i 

000107 

000094 


.000034 

7.0 

.002993 

.001096 

.000458 

.000212 

.000106 

.000056 

.000032 


7.6 

.002456 

000845 




.000035 



8.0 

.002038 

000662 

,000246 

.000102 

.000046 




8 5 

.001710 








9.0 

,001448 

.000422 

.000141 

.000053 





10.0 

.001064 

.000281 

.000085 

.000029 





11.0 

.000804 








12.0 

.000623 

.000138 

.000035 






14.0 

000395 

.000076 







16 0 

000265 

000045 







20.0 

.000137 








24 0 

.000079 








28.0 

000050 

j 








* This table, and Table XLV I, wore taken from Student’s article, “Now Tables for Testinjn; 
the Significance of Observations,” Metron, Vol. V, pp. 114-120. Student, whose real 
name was William Scaly Gosaet, died in 1937. Wo were granted permission by his wife and 
heir, Mrs. Marjory Gosset, to use these tables. Wo have made a few corrections in this 
table which Student reported to Prof. Egon S. Pearson of the University of London and 
which Prof. Pearson passed on to us. In this table we subtracted the entries made by 
Student from 1.00 so as to give the percentage in the tail of the distribution between t m x/<t» 
and w . Table XLVI we used as it stands in Metron, 
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Table XLVI. — Sttobnt^s Table for Correcting Probabilities 
Corresponding to fs When n Exceeds 20 * 


.0100231 

.0203342 

.0311786 

.0427193 

.0650102 

.0679778 
.0814202 
.0950188 
. 1083632 
. 1209854 

. 1323997 
. 1421442 
. 1498190 
.1561177 
. 1578496 

.1579512 
. 1654867 
. 1506370 
. 1436822 
.1349776 

-1249244 

.1139444 

.1024518 

.0908322 

.0794261 

.0686124 

.0683129 

.0489808 

.0406007 

.0332389 

.0268622 

,0214377 

.0168971 

.0131562 

.0101177 

.0076879 

.0067722 

.0042823 

.0031397 

.0022761 

.0016296 

.0011538 

.0008074 

.0006686 

.0003821 

.0002684 

.0001728 

.^01143 

.0000746 

.0000483 

.0000309 

,0000196 

.0000122 

.0000076 

.0000046 

.0000028 

.0000017 

.0000010 

.0000006 

.0000008 


-.001261 
- .002616 

- .004177 

- .006087 

- .008509 

-.011595 

-.015432 

-.019991 

- .026066 

- .030246 

-.034907 

-.038248 

-.039363 

- .037344 
-.031399 

- .020971 

- .005832 
+ .013846 

.037483 

.064114 


C3 

C4 

-.00155 

+ 0.0004 

- .00308 

0.0008 

- .00463 

0.0013 

- .00686 

0.0017 

- .00697 

0.0022 

- .00772 

0.0026 

-.00796 

0.0028 

-.00774 

0.0026 

-.00651 

0.0021 

- .00504 

0.0011 

- .00376 

0.0004 

- .00375 

0,0011 

-.00666 

0.0058 

-.01410 

0.0182 

- .02841 

0.0430 

-.05129 

0.0849 

- .08384 

0.1612 

-.12609 

0.2323 

-.17664 

0.3361 

- .23256 

0.4466 

-.28945 

0.5512 

-.34185 

0.6277 

- .38379 

0 6522 

-.40950 

0.6010 

-.41417 

0.4553 

- .39459 

+ 0.2056 

- .34967 

- 0.1464 

-.28061 

- 0.5809 

- . 19082 

- 1.0704 

-.08559 

- 1.6727 

+ .02849 , 

- 1.3685 

.14423 

- 1.6108 

.25458 

- 1.8372 

.36327 

-2 0348 

.43535 

- 2.7328 

.49749 

- 2.6031 

.63813 

- 2.1237 

.65733 

- 1.6267 

.65667 

- 1.0601 

.53880 

- 0.4417 

.50708 * 

+ 0.1656 

.46619 

0,7026 

.41681 

1.1692 

.36631 

1.5353 

.81356 

1.7916 

.26386 

1,9387 

.21787 

1.9853 

.17663 

1.9462 

.14070 

1.8394 

.11017 

1.6839 

.08485 

1.4986 

.06429 

1.2995 

.04796 

1.1004 

.03627 

0.9107 

.02647 

0.3799 

.01816 

0.6066 

.01274 

0.4370 

.00882 

0.3495 

.00602 

0.2626 

.00406 

0.1989 


* For acknowledgment, $ee footnote to Table XLV. tTse with entrxee In Table XSJV: 

+ a + « + « + a 
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,419 ,489 ,5t8 ,866 ,674 •SOO ,601 .618 .680 .628 .634 

.291 .332 .361 .383 . 400 .414 .425 .435 .444 . 451 .468 

,391 .Jfid ,634 .544 •^^0 ,574 

.272 .311 .339 . 359 . 377 ,392 .403 .413 .421 .428 .434 

,3^ ,433 ,471 .497 .617 .633 .54$ ,637 .666 .674 »53I ,587 
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Table XLVIII. — Valxtbs of P for the Chi-boitare Tert of Goodness 

OF Fit 


1 

n 2 

n ' - 3 

n «• 3 
n '' *• 4 

n “• 4 
n ' “■ 6 

n - 6 
n ' - 6 



n - 8 
n ' - 9 

n ■■ 0 

n ' - 10 

n - 10 
n ' - 11 

1 

1 

.606531 

.801253 

.909796 

.962506 

.985612 

.994829 

.998249 

.999438 

,990828 

2 

.367879 

.572407 

.735759 

.849146 

,919699 

.959840 

.981012 

.991468 

.996340 

Z 

,223130 

.391626 

.657825 

.699986 

.808847 

.885002 

.934357 

.064295 

.981424 

4 

.135335 

.261404 

.406006 

.549416 

.676676 

.779778 

.867123 

,911413 

.947347 

5 

.082085 

.171797 

i .287298 

.415880 

.643813 

.659963 

,757576 

.834308 

.891178 

6 

.049787 

.111610 

.109148 

.306219 

,423190 

.539760 

.647232 

.739919 

,815263 

7 

.030197 

.071897 

.135888 

.220040 

.320847 

.428880 

.636632 

.637119 

.725444 

8 

.018316 

.046012 

.001578 

.156236 

,238103 

.332594 

.433470 

.534146 

.6288,37 

0 

.011109 

.029291 

.061099 

.109064 

.173678 

.252656 

.342296 

.437274 

.532104 

10 

,006738 

.018666 

.040428 

.076236 

.124652 

.188573 

.266020 

.350485 

.440403 

11 

.004087 

.011726 

.026564 

,061380 

* .088376 

.138619 

.201099 

.275709 

.357518 

12 

.002479 

.007383 

.017361 

,034787 

I .061969 

. 100668 

. 151204 

.213308 

.28,5057 

13 

.001603 

.004637 

,011276 

.023379 

.043036 

.072109 

,111850 

. 162007 

.223672 

14 

.000912 

.002906 

.007295 

.015609 

.029636 

,051181 

.081765 

.122325 

.172992 

16 

.000563 

.001817 

.004701 

.010363 

.020256 

.036000 

.069145 

.090937 

.132061 

16 

.0003351 

.001134 

.003019 

.000844 

.013764 

.025116 

.042380 

.066881 

.099632 

17 

.000203! 

.000707 

.001933 

.004500 

.009283 

.017390 

.030109 

.048716 

.074.3 fi 4 

18 

.000123 

,000440 

.001234 

,002947 

.006232 

.011970 

.021226 

.036174 

.054064 

19 

.000076' 

.000273 

.000786 

.001922 

.004104 

.008187 

.014860 

.025193 

.040263 

20 

.000046 

.000170 

,000499 

.001250 

.002769 

.005570 

.010336 

.017013 

.029253 

21 

.000028 

.000106 

.000317 

.000810 

.001835 

.003770 

.007147 

.012650 

.021093 

22 

.000017 

.000066 

.000200 

.000524 

.001211 

.002541 

.004916 

.008880 

.015105 

23 

.000010 

.000040 

.000127 

.000338 

.000796 

.001705 

.003364 

.006197 

.010747 

24 

.000006 

.000026 

.000080 

, 000217 i 

.000522 

.001139 

.002292 

,004301 

.007600 

25 

,000004 

.000016 

.000060 

.0001391 

.000341 

.000759 

.001554 

.002971 

.005345 

26 

.000002 

.000010 

.000032 

1 

.0000901 

.000223 

.000504 

,001060 

,002043 

.003740 

27 

.000001 

.000006 

.000020 

.000057 

.000145 

.000333 

.000707 

.001399 

.002604 

28 

,000001 

.000004 

.000012 

.000037 

.000094 

,000220 

.000474 

.000954 

.001805 

29 

.000001 

.000002 

.000008 

.000023 

.000061 

.000145 

,000317 

.000648 

.001246 

30 

.000000 

.000001 

.000006 

.000015 

.000039 

.000096 

.000211 

.000439 

.000857 

40 

.000000 

.000000 

.000000 

.000000 

.000001 

.000001 

.000003 

.000008 

.000017 

60 

.000000 

.000000 

.000000 

,000000 

.000000 

.000000 

.000000 

.000000 

.000000 

60 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

.000000 

70 

.000000 

.000000 

.000000 

,000000 

.000000 

.000000 

,000000 

.000000 

.000000 


Note: This is the Elderton table, talcen from Pearson's T<ibU$}or Statia^ 
ticiana and BiorndHcUma by arrangement with the publishers* 
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Tablb XL VIII. — VALtms of P fok thb Chi-soctabb Pest of Goodness 
OP Fit. — (Continued) 


1 





n - 16 
n' » 16 

n - 16 
n ' « 17 

n » 17 
n' « 18 

» - 18 
« 19 


1 

.999050 

.999986 

.999997 

.999999 

1. 

1. 

1. 

1. 

1. 

2 

.998496 

.999406 

.999774 

.999917 

.999970 

.999990 

.999997 

.999999 

1. 

3 

.990726 

.996644 

.997934 

.999074 

.999598 

.999830 

.999931 

.999972 

.999989 

4 

.969917 

.983436 

.091191 

,995466 

.997737 

.998903 

.999483 

.999763 

.999894 

5 

.931167 

,957979 

.975193 

.985813 

.992127 

.996764 

.997771 

.998860 

.999431 

6 

.873365 

.916082 

.946163 

.966491 

.979749 

,988095 

.993187 

.996197 

.997929 

7 

.799073 

.857613 

.902151 

.934711 

.957650 

.973260 

.983549 

.990125 

.994213 

8 

.713340 

.785131 

.843601 

.889327 

.923783 

.948867 

.966547 

.978637 

.986671 

0 

.621892 

,702931 

.772943 

.831061 

! .877617 

.913414 

,940261 

.959743 

.973479 

10 

.630387 

.615960 

.693934 

.762183 

.819739 

.866628 

.903610 

.931906 

.962946 

11 

.443263 

.628919 

.610817 

.686036 

.752694 

.809485 

.856564 

.894357 

.923839 

12 

.362642 

.445680 

.627643 

1 .606303 

.679028 

.743980 

.800136 

.847327 

. 885624 

13 

.293326 

,369041 

.447812 

.526524 

.602298 

.672768 

.736186 

.791573 

.838571 

14 

. 232093 

.300708 

.373844 

.449711 

.525529 

.698714 

.667102 

.729091 

.783691 

15 

. 1 S 249 S 

.241436 

.307354 

.378154 

.461418 

.524638 

.596482 

661967 

.722598 

la 

. 141130 

.191236 

.249120 

.313374 

.382051 

.452961 

.523834 

.692647 

.657277 

17 

. 107876 

.149597 

. 199304 

.256178 

.318864 

.385597 

.454366 

.523105 

.589868 

18 

.081581 

.1166911 

.167520 

.206781 

.262666 

.323897 

.388841 

.455663 

.522438 

19 

.061094 

.088520 

.123104 

.164949 

.213734 

.268663 

.328532 

.391823 

.456836 

20 

.045341 

.067086 

.096210 

.130141 

.171932 

.220220 

.274229 

.332819 

,394578 

21 

.033371 

.050380 

,072929 

.101632 

. 136830 

.178510 

.226291 

.279413 

.336801 

22 

.024374 

,037520 

.065362 

.078614 

.107804 

.143191 

.184719 

.231985 

.284256 

23 

,017676 

.027726 

.041677 

.060270 

.084140 

.113736 

.149251 

.190690 

.237342 

24 

.012733 

.020341 

,031130 

,046822 

.065093 

.089504 

.119436 

.156028 

.196162 

25 

.009117 

.0148221 

.023084 

.034566 

.049943 

.069824 

.094710 

.124916 

.160642 

26 

.006490 

.010734 

,017001 

,026887 

.038023 

.054028 

.074461 

.099768 

.130189 

27 

.004595 

.007727 

.012441 

.019264 

.028736 

.041483 

.058068 

.078996 

.104653 

28 

.003238 

.005532 

.009060 

,014228 

,021669 

.031620 

.044^38 

.062055 

.083428 

29 

.002270 

.003940 

.006546 

.010450 

.016085 

.023936 

.034526 

.048379 

.065985 

80: 

.001585 

.002792 

.004710' 

1 

.007632 

.011921 

1 

.018002 

.026345 

.037446 

.061798 

40 

.000036 

.000072 

,000138 

.000256 

.000463 

.000778 

.001294 

.002687 

.003272 

50 

,000001 

.000001 

.000003 

.000006 

.000012 

.000023; 

.000042 

.000076 

.000131 

60 

.000000 

.000000 

.000000 

.000000 

.000000 

,000001 

.000001 

.000002 

.000004 

70 

,000000 

.000000 

.000000 

,000000 

.000000 

.000000 

.000000 

.000000 

.OOOOOC 
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Table XLVIII. — ^Values of P foe the Chi-squaee Test of Goodness 
OF Fit. — (Condvded) 


X* 

n - 20 
n' - 21 

n - 21 
n' « 22 

n 22 

n' - 23 

n « 23 
n' •* 24 

n - 24 
n' - 25 

n ■“ 25 
- 20 

n - 26 
n' - 27 

n - 27 
n' - 28 

It « 28 

n' * 29 

n 29 

n' 30 

1 

1. 

1. 

1. 

1. 

1. 

1. 

1. 

1. 

1. 

1. 

2 

1. 

1. 

1. 

X. 

1. 

1. 

1. 

i 1. 

1. 

1. 

3 

.999996 

.990098 

.999099 

1. 

1. 

1. 

1. 

1 

1, 

1. 

4 

.999964 

.990080 

.999992 

.999997 

,999999 

1. 

1. 

1. 

X, 

1. 

5 

.999722 

.999868 

.999030 

.999972 

.999987 

.999994 

.999908 

.009999 

1. 

1. 

6 

,998898 

.999427 

.099708 

.999855 

.099929 

,999966 

.999984 

.999993 

.990997 

.999999 

7 

.996685 

,998142 

.908980 

.999452 

.999711 

.999851 

.999924 

.999962 

.999981 

.999991 

8 

.99l8t^ 

.99514.3 

997160 

.098371 

.999085 

.999494 

.999726 

.990853 

.999924 

.999960 

9 

,982907 

,989214 

,093331 

.096957 

.997695 

1.998596 

.009194 

.999546 

.909748 

.9998<13 

10 

.968171 

.978012 

.980304 

.991277 

.994647 

i. 996653 

.907081 

.998803 

.099302 

.999599 

11 

.946223 

.962787 

.974749 

.983189 

.989012 

.902046 

.995549 

.997230 

.998315 

.998988 

12 

.916076 

.939617 

.057370 

.970470 

.979908 

.986567 

.991173 

.994294 

,096372 

.997728 

13 

. 877384 

.908624 

.933161 

.951990 

.966121 

.976501 

.98JJ974 

.989247 

.9«29tK) 

,995384 

14 

. 830406 

.809.590 

.001479 

.026871 

.946650 

.961732 

.9730(X) 

.981254 

.987189 

.991377 

15 

.776408 

.822052 

.862238 

.894634 

.920759 

.941383 

.967334 

.969432 

.978436 

.985015 

10 

.716624 

.760650 

.81,5886 

.855268 

.888076 

.914828 

.036203 

.952947 

.965819 

.975530 

17 

.662974 

.7X1100 

.763362 

.809261 

.848662 

,881793 

.9(K8)83i 

.931122 

.948589 

.962181 

18 

.587408 

.(V40004 

.705988 

.757489 

.803008 

.842390 

.875773; 

.003519 

.926149 

,944272 

19 

.521826 

.585140 

.(J45328 

.701224 

.751090 

.797120 

.83<H30 

.870001 

.898136 

.921288 

20 

,457930 

.521261 

.68304(» 

.6419121 

.696776 

.746825 

.791556 

.SIJ0756 

.864464 

.892927 

21 

.307132 

.458044 

.520738 

, 581087 

,638725 

.692tk)9 

.741964 

.786288* 

.825349 

.859149 

22 

.340511 

.390510 

.459880 

.5202521 

.5792671 

.635744 

.688697 

.737377 

.781291 

.820189 

23 

.288796 

.343979 

.401730 

.46077X1 

.510798 

.577664 

.632947 

.685013 

.733041 

.776543 

24 

.242392 

.293058 

.347220 

.403808 

.461597 

.519373 

.575966 

.(m316 

.681535 

.728932 

26 

.201431 

.247104 

.297075 

1 

.350286 

1 

.406760, 

.4623r3| 

.518975 

.674462 

.627835 

.678248 

20 

. 165812 

.206449 

.251082 

.300866! 

,353165 

.407598 

.463105 

.518600 

.573045 

.625491 

27 

. 185264 

, 170853 

.211226 

.256967 

.304453 

.355884 

.409333 

.463794 

.518247 

.571705 

38 

. 109399 

.140151 

.^mx 

.215781 

.200040 

.307853 

.358458 

.410973 

.464447 

.517913 

29 

. 087759 

.114002 

. 144861 

. 180310 

.220131 

.2(J3910 

.811082 

.3(K)899 

.418528 

.465006 

30 

.069854 

.091088 

.118464 

. 149402 

.184752 

.224289 

.267611 

.314154 

.363218 

.414004 

40 

,004995 

.007437 

.010812 

.015369 

.021387 

.029164 

.039012 

.051237 

.066128 

.083937 

50 

.000221 

.000366 

.000586 

.000921 

.001416 

.002131 

.003144 

.004551 

.006467 

.009032 

60 

.000007 

.000013 

.000022 

.000038 

.000064 

.000104 

.000168 

,000264 

.000407 

.000618 

70 

.000000 

.000000 

.000001 

.000001 

.000002 

.000004 

.000007 

.000011 

.00<M>19 

.000030 
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Noth; This table was made bjr H. P. Peters. 
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Table XLIX. — Coefficients of r*& in the Tetkachokic Cokhelation 
Series. — (Continued) 


Coefficient of r^s according to percentage in tail of distribution 
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TA.BLB XLIX. — CoBFFICIKNTfi OP r’s IN THE TeTRACHORIC CORRELATION 
Series. — {Conimued) 
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Tabi-e XLIX. — Coefficients of r^s in the Tetrackorxo Cokkei.ation 
Sbiiies. — (Concluded) 




































TxBtM If. — Wmsr Powbb r*s Cosmsspornfmo to Tbthachohic r’s m Widesfsead Classes. — {Continued) 

Ckirre^oadins r* (first power r) secordlog to pereentftge in tail df distribution 
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Table LI. — The Predicted Location op an Indivibital in a Dependent 
Measurement from His Standino in an Independent One 

r « .05 


Tenth dependent variable 


independent 

D 

8 

7 

0 

6 

4 

3 

2 

1 

I 

014 

823 

728 

032 

533 

432 

329 

224 

no 

II 

000 

814 

718 

020 

621 

420 

aiH 

216 

109 

in 

000 

810 

712 

013 

613 

412 

312 

209 

100 

IV 

904 

800 

707 

008 

608 

407 

307 

206 

103 

V 

001 

802 

f 

003 

603 ; 

402 

302 

201 

U)l 

VI 

899 

790 

008 

698 

497 1 

397 

298 

J9H 

99 

VII 


795 

003 

693 

492 

392 

293 

194 

90 

vni 


791 

088 

687 

487 

3HH 

288 

190 

U 

IX 

891 

786 

082 

680 

479 

380 

282 

180 

91 

X 

88S 

776 

071 

608 

407 

308 

272 

177 

80 


r * .16 



039 

866 

782 

694 

6m) 

497 

389 

274 

BH 


027 

843 

764 

660 

602 

461 

356 

244 



919 

830 

737 

640 

541 

439 

384 

227 


IV 

012 

810 

722 

624 

623 

422 

31H 

214 

HB 

V 

■Ml 

808 

709 

60S 

508 

400 

305 

203 

101 

VI 

899 

707 

696 

694 

492 

302 

291 

192 

94 

vn 

892 

; 7S6 , 

082 

678 

477 

370 

278 ! 

181 

88 

vni 

884 

1 773 

660 

661 

459 

300 

263 ' 

170 

81 

XX 

873 

766 

045 

639 i 

438 

340 

240 

167 

73 

X 

862 


OU 

603 

401 

306 

218 

235 

61 


r - .25 

■ ■■ - ^ 


I 

900 

902 

833 

764 

664 

SOS 

MM 

H9 

184 

11 

944 

872 

791 

702 

606 

602 



146 

111 

933 

862 

703 

m 

609 

406 

mlm 

Br B 

126 

IV 

92$ 

834 

739 

641 

640 

436 


B 

no 


912 

816 

717 

616 

613 

409 

306 

B$B 

98 

BOB 

902 

799 

696 

591 

487 

384 

Bll 

184 

88 


890 

779 

671 

664 

460 

369 

B9 

HW 

77 


875 

766 

643 > 

636 

431 

831 

Ka 

148 

67 

BIB 

865 

726 


496 

896 

298 

209 

128 

66 

|eB 

816 

672 

647 

436 

336 

246 

187 

98 

40 


Noth: Tenths in the independent fftotor are indicated by the Roman 
numerals at the left while tenths in the dependent one are at the tops of 
columns. Example for reading the table; Skeletal development and intelli* 
genoe test scores are oorrelated to the extent of +.06, A boy stands in the 
third tenth in skeletal development (theoretioaJily at the xnJd>point of that 
tenth). The chances are 106 in 1,000 that he will be found in the highest 
tenth in intelligence (no lower than its lower border); th»y are 200 in 1,000 
that he will be in the second tenth or higher; 813 in 1,000 that he will be in 
the third tenth or better; etc. 

This table was made by Richard P. T. Scott. 
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Tablk LL — The Phbpxctbd Location of an Inpividual in a Dependent 
MEAR trKEMENT FU<iM Hi8 Standino IN AN INDEPENDENT Onk. — (Continued) 

r « ,35 


Tt'ntli depi'iuU'iit varmbk 


indopondont 

9 

8 

7 

6 

6 

4 

3 

2 

1 

I 

070 

03f> 

880 

812 

731 

636 

522 

388 

228 

n 

000 

■tW 

828 

745 

051 

546 

431 

305 

164 

ni 

047 

875 

702 

600 

690 

403 

370 

250 

132 

IV 

005 

851 

750 

061 

657 

450 

330 

226 

110 

V 

mmM 

828 

728 

625 

510 

412 

304 

107 

03 

VI 

007 

803 

606 

688 

481 

376 

272 

172 

70 

vn 

800 

77f> 

661 

550 

443 

330 

241 

140 

66 

vni 

868 

741 

621 

607 

401 

301 

208 

125 

S3 

IX 

886 

605 


454 

340 

256 1 

172 

00 

40 

X 

774 

612 

1 

478 

365 

200 

188 i 

120 


24 


r ,45 


I 

088 

062 

022 

867 

706 

707 

605 

456 

272 

II 

075 

028 

866 

700 

600 

504 

474 

337 

181 

in 

062 

000 

823 

734 

m 

622 

402 

273 

137 

IV 

048 

872 

783 

684 

577 

464 

347 

227 

107 

V 

033 

843 

742 

636 

625 

413 

300 

100 

85 

VI 

015 

810 

700 

587 

475 

364 


157 

87 

vn 

803 

773 

653 i 

536 




128 1 

62 

vin 

863 

727 

608 : 

478 


1 » 


100 1 

38 

XX 

810 

663 

526 

406 


1 


72 

25 

X 1 

728 

645 

405 



lil 


38 

12 


f - .50 


1 

002 

073 


803 

820 

744 

635 

401 

208 

n 

081 

042 


814 

725 

620 

407 

354 

180 

lU 

060 

013 


752 

652 

580 

414 

280 

138 

IV 

066 

884 


607 

588 

472 

851 

227 

104 


940 

852 

751 

642 

520 

418 

207 

184 

80 


020 

816 

708 

587 

471 

85$ 

249 

148 

60 


806 

773 

640 

52$ 

412 

803 

204 

lie 

44 

Bum 

862 

720 

586 

461 

848 

248 

160 

87 

31 

IX 

an 

646 

508 

380 

275 

186 

114 

58 

10 

X 

702 

j 

500 

865 

256 

171 

107 

60 

28 

8 


r - .55 
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TaBI^K LL — TlIiQ PEBDirTBD LOCATION OF AN INDIVIDUAL IN A DkFKNDBNT 
Mbasuhbment FttoM His Standing in an Indkpicndent Onk*— (C widw^icri) 

r « .65 

































INDEX 


A 

Alionaticn, etiefTioiont of, 116 
Allport, h . H., 82 
Amos, C. 10., 380 
Arithmetic tiican, 41 
Attoiuiation, correcting for, 203 
Average deviation, OS-hBT, 81 
from the mean, 64-66 
from the median, 66-“67 
Average intereorrelation, lOO-SlOl 
from ranks, 200-201 
Average, t^orrelation between, 193- 
196 

B 

Beagle, B. M., 457 
Beta coefHcienta, 223, 237 . 

Biserial correlation, 362-366 
formulaH for, 364, 385 
stantiard error of, 365 
from witlcHpwmd classeB, 384-391 
standard error of, 389-391 
Blakeman test, 318 
Bojtd, Mva, 352 
Burgess, K. W., 392, 402, 416 
Burt, C. L., 252, 438 

C 

Central tendency, 40-62 
Centroid method, 252 
Chi square, SI 9, 404-428 
distHbuUon of, 407-408, 498-500 
nature of, 404-412 
probability aquation for, 409 
rdatlon to F and «, 419-420 
use In contingency tables, 414-417 
use in curve fitting, 417-418 
OommuniOity, 255 
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Contingency correlation, 391-393 
Copper, J. A., 453, 400, 467 
Correcting cooificieuts of correlation, 
for attenuation, 203 
for biius, 1 52 

for broad categories, 393-399 
for ht'torogeneity, 208-212 
for overlapping, 212-217 
Correlation, aids for computing, 
501^507 

assumptions in, 109 
bias in, 153 
bisi'rial, 362-366 
from widespread classes, 384- 
391 

chart for, 100 

corrcH!ting for attenuation, 203 
correcting for broad categories, 
393-399 

correcting for heterogeneity, 208- 
212 

correcting for overlapping, 212- 
217 

formula derivation, 94-96 
hetwtwn gains, 460-463 
intraclasM, 201-202 
limits of, 117-118 
mean-square contingency, 391- 
393 

between moans, 160-162 
nature of, 91-96 
as overlapping, 118-123 
partial and multiple, 220-226 
predicted for lengthened tests, 
193-196 

produce moment, 91-110 
Spearman ranks, 103-109 
spurious, 217 

between squared measures, ISl 
between standard deviations, 182 
standaid erfor of, 152-155 
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Correlation, between sums of 
samplcvs, 193, 214, 217 
sums and differences formulas, 
101-103 

totrachorio, 3GC-375 
from widespread classes, 375- 
384 

translating to s', 155 
from unequal intervals, 399-402 
between variates and means or 
index values, 396-399 
Correlation chart, 100 
Correlation rat.io, 312-330 
correcting for broad categories, 
323 

fortmilas for, 312, 316 
partial, 326-327 

relation to analysis of variance, 
353-357, 421-422 
unbiased, 3 1 9-326 
Correlation surface, 368, 410 
Cottrell, L. S., 392, 402, 415 
Courtis, S. A., 436, 440 
Covariance, 351, 463 
Craig, C. 0,, 443 
Crayton, S. G., 124 
Curve, Gompertz, 426, 435-441 
growth and decay, 425, 431-435 
normal, 279-311 
normal ogive, 76, 420, 435 
parabola, 425, 429-431 
Pearsonian system, 441-444 
straight lino, 1-2, 427-429 

D 

D, standard error of, 151 
symbol for range first to ninth 
deciles, 75 

Degrees of freedom, 349-851, 364- 
355, 412-414, 417-418 
Derivative, definition of, 3 
of the function 7 
of a function of a funcrion, 18 
of an inverse fimctbn, 18 
of a bgarithm, 20-22 
of the normal curve funotioni 26- 
28 


Derivative, of power forms, 22 *24 
of a product, 16 
of a quoti(*nt, 17 
of a sine, 28-30 
of a sum of functions, 8 
Determination, coefficient of, 117, 
332 

Differentiation, fundamental steps, 5 
meaning of, 3-6 
partial, 30-31 

successive, 13-14, 16, 27-28 
Distribution, of chi square, 407-408, 
498-500 

of epsilon square, 494-497 
Huntington's approach to, 422 “ 
423 

normal, 481-487 
of Student's t, 171-176, 421, 488- 
493 

of variance estimates, 349 
of z and F, 420 
Doolittle, M. lU 226 
Doolittle inotho(l, 226-238 
Dunlap, J. W., 158 

1 ] 

e (mathematical constant), 19-20 
Eaton, M. T., 359 
Elderton, W. F., 419, 484, 498 
Epsilon, the unbiased correlation 
ratio, 319“324 

corrected for brmwi categories, 
323 

distribution of, 325, 494-497 
relation to analysis of variance, 
363-357 

relation to F, 421 
standard error of, 824 
for testing goodness of fit, 327- 
830,441 

Eta, the correlation ratio, 312-319 
standard error of, 316 
Experimentation, effect of replioa- 
tion in, 469-474 

effect of valid measures in, 474- 
476 

technique of, 445-477 
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F 

F, Snedccor's variance ratio, 336 
relation to chi square, 41(M20 
relation to (Epsilon, 42l-*422 
relation to 2 , 420 
Forger, W. F., 56 
Fiducial limits, 137-130, 476-477 
Filon, L* N. G,, 135 
Fisher, R. A., 69, 138, 139, 142, 153, 
164, 155, 156, 172, 173, 178, 
179, 188, 202, 318, 324, 334, 
336, 336, 346, 347, 349, 351, 
355, 412, 419, 421, 423, 403, 476 
Frank, G,, 82 
Fredcriksen, N,, 82 
Freeman, F. N., 183, 457 
Freeman, H., 82 

G 

Gains, correlation between, 400-'462 
reliability of difftTcm^e, 167“-169 
Gates, A. L, 452 
Geary, R. 0., 308, 309, 310 
Geometric mean, 54 
GomperU, B., 425, 435, 436, 441 
Goodness of 6t, testing, 308“"“310, 
327-330, 357, 410, 441, 498-500 
Gosset, Mrs. Marjory, 492 
Gosset, William B<mly, 492 
Grt^saer, Dessa K., 229, 231, 232, 236, 
237, 241 

Griffin, C. H., 494 
Guilford, J. E, 266, 273 


Harmonic mean, 55 
Harris, J. A., 202 
Henry, H. 0,, 185 
Heterogeneity, correcting for, 208- 
212 

Hoefer, Carolyn, 188 
Holeingar, K. J., 49, 210 
Homoice<ket!city, 117 

252, 275, 277 
Hovfa, B. a, 211, 212 
Huntingtem, S. V., 432 


I 

Institutionalization, index of, 82-84 
Integration, 31-39 
applied to areas, 35 
applied to equation of curve, 37 
limits of, 36-37 
by parts, 38 
standard forms, 3*1-35 
siiccessive, 38 

Intervals, designation of, 49-50 
Intraclass correlation, 201-202 
Irwin, J. 0., 139, 341 
Isserlis, L., 326 

J 

Jacks, R. W., 381 
Jackson, D,, 423 
Jones, IX C., 128 
j-shaped curves, 82 

K 

Kelley, T. L,, 49, 109, 121, 128, 135 
209, 210, 225, 252, 277, 320, 353, 
355, 392, 397 

Kenney, J. F., 406, 417, 442 
Kondo, T,, 141, 484 
Krupa, J. H., 389 
Kurtosis, fit as mt^asurn of, 79 
of normal distribution, 292-294 
standard error of, 166 
of Student^s distribution, 171 
of 155 
Kurts, A. K., 168 

L 

I>atin square, 344-348 
Grtwo-, 347 

Iieast stjuares, principle of, 299-300 
use in curve fitting, 426 
landquiflt, F. E., 164, 167 
Liningery F. F«, 899 

M 

MoCkU, W. A., 810, 476 
Matchi^ gronpe, 448^^51, 40Sr4^ 
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Maxima and minima, 10-15 
Mean, arithmetic, 41-50 
from assumed mean, 46 
assumptions in grouped data, 50- 
67 

geometric, 54 
of grouped scores, 44 
harmonic, 55 
by intervals, 44 

reliability of difference, 160-176, 
361-353, 452-455 
standard error of, 126-135 
Median, 50-52 
deviation, 75 
standard error of, 147 
versus mid-score, 52 
Mercer, Margaret, 275, 276 
Mill, John Stuart, 118 
Mode, 52-54 

Multiple correlation, 238-240 
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